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INTRODUCTION 



The Syracuse University Research Corporation ha h prepared 
this report for the information and use of the„ U„ S. Office 
of Education in their preparation of a broad study of Educa- 
tional Research and Development in the United States. The 
USCE study was undertaken at the request of the Organisation 
for Economic Cooperation and Development (OECD). 1 

Very briefly, SURC 1 s task was to explore four questions: 

Who are the sponsors, and where are the centers of 
major educational R&D in the United States? 

- What are the organizational arrangements and the 
management strategies and procedures for allocating 
resources to and within educational R&D? 

- What is the recent and present impact of educational 
R&D on educational practice? 

- What are the current attitudes of educators and 
policymakers toward3 educational R&D? 

The investigation was conducted principally through struc- 
tured interviews and questionnaires , unstructured interviews, 
and review of the literature (including formal reports from 
relevant organizations) . Three functionally distinct parti- 
cipant groups in the R&D process were identified as being 
appropriate subjects of study: the sponsors of educational 

R&D projects and programs, the performers of educational R&D, 
and the users of the performers' output , (Although these 
three groupings are functionally distinct, it often happens 
that two or more of the participant functions are performed 
within the same organization; however, this fact has little 
bearing on the conduct or the results of the investigation) . 

With the participating groups being so identified, it becomes 
apparent that the first t\\o questions to be explored — as 
set forth above -- have to do with the sponsors and the per- 
formers (centers) of educational R&D. The users are involved 



^The OECD is the successor to the Organization for European 
Economic Cooperation, which had its inception in 1948 as the 
major policymaking and research body for the Marshall Plan. 
It is based in Paris. 
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only passively -- insofar as sponsors and performers react 
to wants or needs as expressed by the users. However, ai] 
three groups, and especially the users, are important to any 
investigation of the third and fourth questions, which have 
to do with the impact of educational R£ D and attitudes to- 
ward it. The users are, after all, the ultimate determiners 
of impact: if the results of educational R&D are not used, 

then there will obviously be no impact on educati.onal prac- 
tice. However, the sponsors and performers influence the 
actions of the users by their response to the (passive) 
feedback role of the users. It is a fair, although perhaps 
over-simplified, assumption that impact is more significant 
when sponsors and performers pay attention to felt needs of 
users, and/or when they concern themselves with the delivery- 
one might even say the promotion -- of research results. 

Thus, the inquiry falls into two sets of questions, rather 
than into four separate ones. This report is organized 
around the questions of performance and of use and the me- 
thodology was similarly organized. The term ’'performance " , 
as used here, includes "sponsorship". 



1 , Sponsors 

The twcT major sponsoring groups of educational r&O 
are Federal agencies and private foundations. It 
was agreed with the USOE that, so far as sponsors 
are concerned, the research would be concentrated 
on these two groups. The purpose was principally 
to elicit the facts necessary to describe their 
management strategies, chief among these being cri- 
teria for allocating funds among the many alterna- 
tive research possibilities, and the degree of their 
concern with dissemination and classroom implementa- 
tion of research results. The most important 
research tool was an individually structured inter- 
view with officials of the sponsor agencies, supple- 
mented by official and semi-official reports, 
Congressional documents, and ov.her relevant pub- 
lished material. Numerous interviews were also had, 
with knowledgable people other than agency officials 
During the course of these interviews valuable in- 
sight was gained into sponsor strategies and opera- 
tions from the point-of-view of outside observers. ^ 



Officials of six Federal sponsoring agencies were 
interviewed. Among them were two Bureaus of the 
USOE -- the Bureau of Research (which administers 
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^Appendix A contains a list of the people interviewed in both 
sponsor and performer categories. 
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roughly three-fourths of the educational R&D funds 
provided by the Federal Government) , and the Eureau 
of Education for the Handicapped. The four other 
Federal agencies were the National Science Founda- 
tion, the Office of Economic Opportunity, the 
National Institute of Mental Health, and the National 
Institute of Child Health and Human Development. 

These interviews, along with others in Washington, 
D.C., were conducted by the Project Director. 

Personal interviews, under the direction of a single 
member of the staff, were held with officials of six 
major Foundations believed to be active in sponsor- 
ing educational R&D. Another six Foundations were 
queried by mail. All 12 responded fully. 

2 . Performers 

Among the performers of educational R&D, attention 
was directed to the Universities, to the R&D Centers 
and Regional Educational Laboratories sponsored by 
the USOE's Bureau of Research, and to several of the 
State Departments of Education (or their equivalent) . 
The technique was a uniformly structured interview, 
again supplemented by reports and other documents. 

All interviews were high-level -- typically with 
University Deans, with Directors or Associate Direc- 
tors of R&D Centers and Labs, and with directors of 
research activities in the State Departments of 
Education . 



As was the case with the sponsor groups, the selec- 
tion of institutions and organizations whose person- 
nel would be interviewed was made in consultation 
with UCOE. Altogether, 47 institutions or organi- 
zations were included in this group: 16 Universities 

13 R&D Canters, ^ nine Regional Labs, and nine State 
Departments of Education. Some of the interviews 
were multiple? hence, there were 6C individual re- 
spondents in this group. 



In contrast with the sponsor groups, where there was 
a geographic concentration of interview respondents 
so that a single staff member could conduct all 



^The questionnaire schedule is in Appendix A. 

2 

For convenience, five institutions which are not strictly 
R&D Centers are included in this classification: the two 

Educational Policy Research Canters, the National Laboratory 
on Early Childhood, and the two Vocational Education Centers. 
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interviews, the parsons to be interviewed in the 
performer category were scattered throughout the 
country. It was recessary, therefore, to recruit a 
number of interviewers -- 14 in all -- who were 
reasonable close to the interview sites. This pro- 
cedure had the built-in potential disadvantage of 
producing interview results of varying quality, 
and/or with emphasis on different aspects of the 
questions which were being explored. However, the 
interviewers were given identical, specific, and 
detailed instructions, and most of the respondents 
cooperated fully Thus, although some non-uniformity 
was inevitable, the interview results, on the whole, 
turned out to be significantly informative. 

T . Users 

The purpose of surveying potential users of educa- 
tional R&D output was, of course, tu gather infor- 
mation relating to the impact of R&D efforts on 
educational policies and practices at the point of 
ultimate potential delivery -- the classroom. Dis- 
trict school superintendents were determined to be 
the most reliable population as the source of infor- 
mation on a sound sampling b3sis. 

This segment of the overall study was conducted by 
the Bureau of Social Science Research. 1 The techni- 
que was a pre-test in 55 structured interviews, fol- 
lowed by a mail questionnaire which was s*nt to 5*M 
superintendents of districts with enrollments of LO0-- 
100,000 students. Both the interview sample and the 
questionnaire sample were stratified according to 
six enrollment-size categories and nine geographic 
regions . 2 

The response rate for the interviews was 100%? no 
refusals were encountered. The response rate for 
the questionnaire survey ^as disappointing. In spite 
of several follow-up efforts, replies were received 
from only 60% of the district superintendents who 
received the mail questionnaires. However, statisti- 
cal tests indicate that the response rate dees not 
materially affect the reliability of the sample. 



^Under contract with SURC. SURC takes full responsibility 
for the interpretation of the BSSR findings. 

full statement of methodology and a summary of the BSSR 
findings is in Appendix B. 
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4 . Limitations and Guidelines 

The major limitation in this study was time. It is 
not unusual for individuals conducting or partici- 
pating in research projects to complain that there 
was not enough time to do the job as thoroughly as 
they would like to do it. In this case, however, the 
time restriction was particularly severe. The pro^- 
ject was initiated cn October 1, 1968. An initial 
date of January 10 was set for an interim report on 
the results of the .ield investigation of sponsors 
and performers. This deadline was subsequently ex- 
tended to February 19, but the respite did not come 
until after the major part of the field investigation 
was completed. Consequently, for all practical pur- 
poses somewhat less than three and a half months 
could be dev ted to planning the content of the field 
investigation, constructing interview and question- 
naire schedules, recruiting interviewers in widely 
scattered areas cf the nation, arranging interview 
dates, conducting and writing up the interviews, and 
a myriad of other details. All of this was done 
prior to January 10. 

A somewhat more generous timetable (but nevertheless 
a highly restrictive one) was considered to be feasi- 
ble for planning and conducting the field investiga- 
tion of the district school superintendents. 

There were several consequences of the severity of 
the time limitations: 

a. First, interview schedules and questionnaire 
instruments could not be pre-tested (except, in 
a minor way, the questionaire which was sent to 
the district school superintendents), and there 
was no adequate follow-up on those few inter- 
view results which were not fully satisfactory. 
However, these factors affect the validity of 
the general conclusions in only a minor way, if 
at all. 

b. The restrictive time element was recognized at 
the outsit, both by SURC and by USOE. Accord- 
ingly, it was agreed that the investigation of 
each of the functional groups of R&D partici- 
pants — the sponsors, the performers, and the 
users -- would be limited to selected elements 
in each group. This factor does, in some cases, 
affect the general application of some conclusions. 
For example, the conclusions about the R&D Centers 
and the Regional Labs sponsored by the USOE 
Bureau of Research can not be generalized to 



cover other similar organizations sponsored by 
other Federal Government agencies simply because 
the other similar organizations were not covered 
by the investigation. The text attempts to 
clearify limits of general! zability, as a result, 

c. A mere regrettable consequence is due not only 
1:o the stringency of the time limit, but also 
to the USOE's own deadline of July 1 , 1969 for 
submission of its report to OECD. In order for 
the material to be useful to the USOE in the 
preparation of that report, it had to be in the 
hands of the USOE drafters in early June, It 
was impossible by that time to prepare a complete 
and final report, such as this one. Instead, 
material was furnished to USOE as a series of 
drafts of those portions of the final report 
which could be completed by early June, and which 
were considered to be of the greatest relevance 
to the OECD document. Accordingly, the deadline 
for the formal and final report was extended to 
October 15. 

Two events of significance to the future of educational R&D 
occurred subsequent to the early June deadline date of the 
USOE. The first of these was the announcement by the Commis- 
sioner of Education on July 17 of a major reorganization of 
USOE's management of R&D funds, and a strong policy emphasis 
on R&D activities which would "get the good, new ideas into 
practice — and get them there quickly". 

The second was the President's statement, in connection with 
his proposed drastic revision of the Federal welfare programs, 
that future Office of Economic Opportunity financing would put 
more stress on experimental projects than has been the case in 
the past. The President said; M 0E0 is to be a laboratory 
agency, where the new ideas for helping people are tried on 
a pilot basi? When these are proved successful, they can be 
'spun off’ to operating agencies or departments..." Tha ex- 
perimental, or pilot study, approach to educational R&D has 
already been used to a limited extent by 0E0 in connection 
with Head Start, Parent-Child Centers, and Job Corps projects. 
This is a technique of educational R&D which has been used 
sparingly in the R&D community, but opportunities exist for 
its application in currently operating programs of the USOE, 
notably the use of Title I and Title III funds. The specific 
use of these funds and the administration of projects financed 
by them is now a responsibility of State and local govern- 
ments, but again, this is a minor complicating factor only. 





SUMMARY 



This report has been prepared for the Bureau of Research of 
the U.S. Office of Education as part of its comprehensive 
study of educational research and development in the United 
States, 

Structured interviews and questionnaires, interviews and 
bibliographic research were the basic techniques of this in- 
vestigation directed toward the sponsors, performers and users 
of educational research and development. 

What this report indicates is that educational research and 
development ; 

1. Is sponsored primarily by the Federal government, 
but that in agencies other than the USOE, the re- 
sults of such research are frequently lost to the 
general educational system; 

2. Is sponsored by foundations as pa::t of more general 
programs rarely identified as specifically educa- 
tional R&D ; 

3. is shifting from project to programmatic, and from 
theoretical to applied, and 

4. Has had less than satisfactory impact on the prac- 
tices of the users in the eyes of sponsors and per- 
formers, and correlatively ; 

5. Has not achieved significant popularity and accep- 
tance in the opinion of those for whom the work is 
intended, the users. 

The scope of this investigation does not permit hard and fast 
conclusions, but it seems clear that the combination of project- 
oriented research and inadequate two-way communication (of 
felt needs to the sponsors and performers and results of re- 
search to the users) have been the central sources of the 
dilemma. 

The increased emphasis on the programming view and the improve- 
ment of communication are both relatively recent, and there 
is reason to hope that gains will be achieved in significant 
measure. Yet, because they are so critical to a successful 
research enterprise, the present level of development is far 
from adequate. As the report observes, the mandate is there 
and tho will is there; but the knowledge, instrumentalities 
and funds necessary to develop instrumentalities are not. 
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Finally, it should be noted that a study of this type simply 
reveals a set of conditions that existed at the time of the 
investigation. What is lacking that can only be achieved by 
continuing study, or at least frequent study, is a sense of 
the changes and rates of change in sponsor goals, performer 
methods and user attitudes which are essential to policy 
formulation . 
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CHAPTER I 



SPONSORS OF EDUCATIONAL R&D — THE GOVERNMENT AGENCIES 



By far the most important sponsoring entities of educational 
research and development are government agencies. These are 
principally Federal agencies, but State agencies have a poten- 
tially important role, and one which (it is to be hoped) will 
be increasingly effective. ^ 

It is almost impossible to estimate the level of government 
expenditures on educational R&D . Much depends on what is 
called "educational R&D" for statistical purposes. However, 
it is clear that using conventional definitions, the expendi- 
tures in recent years have been in excess of $15C million 
annually, with some estimates going as high as $200 million. 
Expenditures increased very sharply afte~ the passage of the 
Elementary and Secondary Education Act of 1965, and apparently 
have reached a plateau. It is also clear — as is frequently 
pointed out in discussions of the magnitude of educational 
R&D activity -- that, whatever the precise figure of expendi- 
tures, it is v^ry low as compared to (a) Government R&D ex- 
penditures for many other purposes, and to (b) total expen- 
ditures on education. It is questionable whether these com- 
parisons have any real meaning. Much more significant would 
be to judge the level of educational R&D expenditures against 
the needs of the educational system for R&D output, and against 
the capacity of the R&D sponsoring agencies to provide rele- 
vant output. For these purposes, a description of the func- 
tions and strategies of the sponsoring agencies is more re- 
vealing than the level of their expenditures. 



GENERAL COMMENTS 



Government sponsoring agencies can be divided into several 
categories that relate to the importance of their R&D spon- 
sorship in the total R&D activity; to the breadth of the in- 
tended impact of their R&D sponsorship on the educational 
sy3tem, and to the relationship of their R6D sponsorship to 
the program of the larger organization (department, office, 
etc.) to which they are attached. 



*In initial investigation, the State agencies were classified 
as performers of educational R&D, and not as sponsors . In fact, 
however, they are both. Consequently, their sponrorship role 
will be discussed, but only briefly, in this chapter. 
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In rough hierarchical order, the agencies so categorized 
would be as follows: 



Agencies whos^ sole purpose is the improvement of 
education over a broad spectrum of che educational 
system. The only example among the Federal govern- 
ment agencies is the Bureau of Research of the Office 
of Education,^ which also has, by far, the largest 
amount of Federal funds at its disposal, and which 
has the broadest legislative mandate for the support 
of educational R&D . To the extent that they are 
sponsors, the State Departments of Education would 
also fit into this category. 



2. Agencies whose purpose is to improve education in 
specific fields of formal education. The major ex- 
ample here is the National Science Foundation through 
its curriculum-development programs. 

3. Agencies whose purpose is to improve education for 
specified clientele groups: 



a. In broad furtherance of the program activities 
of the larger agency of which it is a part. 

The research sponsorship of the Office of Eco- 
nomic Opportunity would fall within this cate- 
gory, because it is directed primarily towards 
improving compensatory education for disadvantaged 
groups . 

b. In direct furtherance of the program activities 
of the larger agency of which it is a part. The 
clearest example of this is the Division of re- 
search of the USOE 1 s Bureau of Education for the 
Handicapped. Another example would be the spon- 
sorship of vocational education research, which 
comes under the direction of the Bureau of Re- 
search, although the program operation lies else- 
where in the USOh\ The point here is that the 
R&D funds are legislatively tied to a very spe- 
cific program activity. 



4, Agencies whose educational R&D sponsorship is inci- 
dental to -- or a by-product of — its sponsorship 
of research and development in a field which is 
broader than education per se . The two examples 
here are the National Institute of Child Health and 



^Now re-named and reorganized, as was pointed out in the in- 
troduction summary. 
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Human Development and the National Institute of 
Mental Health* Neither agency sponsors educational 
R&D as such. Both sponsor projects which have im- 
plications for the improvement of education, however. 

5. Agencies whose educational R&D sponsorship is pri- 
marily for the purpose of meeting their own operating 
requirements. The examples are various agencies in 
the Department of Defense# where educational R&D is 
directed toward improving the quality of manpower 
for military purposes* However, the techniques of 
manpower improvement "for military purposes 1 ' can 
(and do) have non-military applications. The DOD 
sponsorship is intended to meet internal DOD needs. 

Any external benefits are incidental. 

In the following sections of this Chapter the management 
strategies of the major sponsoring agencies 1 will be discussed 
in some detail. However, from the above brief categorizations, 
a major conclusion should be clear. This is that Federal gov- 
ernment sponsorship of educational R&D is highly diverse and, 
to a considerable extent, is governed by the program needs of 
the sponsoring agencies. Another conclusion# apparent from 
informal discussions and interviews is that a great deal of 
knowledge which could lead to the improvement of general edu- 
cation is generated by agencies which have no specific interest 
in such improvement, and that this knowledge is not systema- 
tically made available to the educational community. 



1 * General 

The Bureau of Research of the U*S* Office of Educa- 
tion, recently moved to the Commissioner's Office 
and re-named the National Center for Educational 
R&D, is the only major U.S. Government institution 
whose sole job it is to administer funds for educa- 
tional research and development. It also commands 
by far the largest block of funds for this purpose — 
some $70 to $80 million under the Cooperative Re- 
search Act, some $11 million under the Vocational 
Education Act (for the fiscal year 1969) , and some 
$3 million under the Higher Education Act. 

In addition to the size of its budget, the Bureau 
is unique among Government agencies involved in 
financing educational R&D in the wide latitude it 



^rtith the exception of the Department of Defense, which was 
specifically omitted from our terms of reference. 
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has under its legislative mandate* In contrast to 
other Government agencies 1 constraints, which gen- 
erally require tha-: educational R&D funds must be 
used for very specific purposes, the Bureau can sup- 
port almost any research and/or development activity 
which reasonably can be related to the improvement 
of education at any level. 

Until FY 1966, the Bureau operated on a very much 
smaller budget -- approximately $5 million. Then, 
as a consequence of the authorizing legislation of 
Title IV of the Elementary and Secondary Education 
Act of 1965, the budget reached its present magni- 
tude . 

2 . Management Strategy 

These three factors -- the size of the Bureau’s 
budget, the wide latitude it has for action, and its 
recent and rapid growth -- make it understandable 
that the Bureau’s management strategy has, until re- 
cently, evolved from a set of seemingly unrelated 
decisions, rather than from a pre-planned and pro- 
grammatic analysis of educational R6D requirements. 

Fiscal Year 1966 can be taken as a break-off point 
between a relatively small program of educational R&D, 
and a significantly large one for the Bureau. Prior 
to FY 1966, the Bureau’s allocation of funds to re- 
search activities and projects had been controlled 
by its external National Advisory Committee, which 
was composed of highly respected University re- 
searchers from schools of education and departments 
of psychology. The Bureau staff acted largely as a 
secretariat for the Committee. Consequently, when 
the quantum increase in funds put the Bureau in 
command of educational R&D resources far in excess 
of any that previously had been available, it v T as 
almost inevitable that the strategic decision would 
be to do more of the same -- but on a grander scale. 

Thus, special groups of outside consultants were set 
up from the same academic community which was over- 
whelmingly represented on the National Advisory 
Committee to advise about -- actually to determine -- 
the shape of the Bureau’s strategy. At this time, 
the staff of the Bureau still served more as a sec- 
retariat for the National Advisory Committee (and 
the consultants) than it did as a creative policy 
making organization. 

From this situation there emerged a decision to ex- 
pand the system of university-based Research and 
Development Centers and more widely-based Regional 
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Educational Laboratories which were envisioned by 
the Elementary and Secondary Education Act. There 
is no inference to be drawn here that the decision 
was wrong or right. This simply is a statement of 
historical fact: that the initial strategy of the 

Bureau after FY 1966 was shaped by the decision to 
build on existing institutional arrangements. Roughly 
half of the Bureau's funds are now locked into the 
support of these institutions, whose varied inter- 
ests and missions are illustrated in Appendix D 
(which lists the existing centers and laboratories, 
together with a description of their activities). 

There can be no question but that the research and 
output of those Centers and Laboratories is signi- 
ficant; that they are concerned with important ed- 
ucational problems; tnat they were selected for 
funding with due consideration to the relevance of 
their missions to current or foreseeable problems 
of education in the United States, and that the 
scientific and technical competence of their staffs 
is of high quality. These were the criteria used 
by two independent groups of academic consultants -- 
one for the R&D Centers, and one for the Regional 
Laboratories -- to establish the core of the R&D 
activities now supported by the Bureau of Research. 

The missing criterion was balancing of the missions 
of the institutions into a coherent whole which 
would assure that, taken together, the output would 
be directed towards the most pressing educational 
problems of today and towards those of the foresee- 
able future. 1 

Against this background, the Bureau staff for the 
past two years or so has been developing a manage- 
ment strategy which would incorporate the missing 
criteria into its operations. In its present form, 
as approved in early 1969 by its present National 
Advisory Council, it covers the following elements: 



1 The failure to include "long-range futures" as a criterion 
has since been rectified by che staff-inspired creation of two 
R&D Policy Centers -- one at Stanford, and one at Syracuse. 

"In contrast to its predecessor/ the National Advisory Com- 
mittee, the Council's membership is more broadly based, and 
it operates more in an advisory, rather than in a decision- 
making, capacity. 
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a. The identification of four basic factors in the 
American society which affect the direction in 
which improvements in education should move {and 
hence the direction of educational R&D) are: 

(1) rapid structural and technological changes; 

(2) rapid changes in the demographic structure 
with respect to rural, urban, and suburban pop- 
ulations; (3) movement from independent to de- 
pendent lire styles, including a shift from 
generalized to specialized occupations, and (4) 
rising demands for full participation in the 
society, especially from "disadvantaged" groups. 

b. The identification of seven priority areas for 

educational R&D, in light of the four factors 
cited above are: (1) Equality of educational 

opportunity (often expressed as equality of edu- 
cational results); (2) Urban education; (3) Early 
learning; (4) Vocational, technical, and occupa- 
tional education? (5) Improving the relevance of 
general education; (6) Professional and Continu- 
ing education, and (7) The finance and organiza- 
tion of education. 

c. These priority areas are not listed in order of 

priority. Indeed, they can not be, not only be- 
cause there are no objective standards by which 
to measure their relative importance, but be- 
cause they obviously overlap: an allocation of 

funds to any one of them as_ such would also be 
an allocation of funds to one or more of the 
others. Consequently, the Bureau staff has de- 
fined five major m issions, which are conceptually, 
if not entirely operationally, mutually exclu- 
sive, and proposes in its planning for the next 
five years (i) to allocate funds according to a 
roughly determined proportionality of funding 
requirements as among the several missions; 
while ( i i ) maintaining a watching brief to make 
sure that all seven priority areas are being ad- 
equately considered, and (iii) making a contin- 
uing re -appraisal of developments in priority 
areas so as to be in a flexible position to re- 
structure the funding patterns. 

d. Very briefly described, these five missions are: 

(i) To discover (or invent) educational techni- 
que*; ana methodologies which will substan- 
tially improve current educational practice. 
The Bureau intends to devote half of its 
resources to this purpose. 
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In the familiar Research and Development 
language/ this means that the major emphasis 
will be on Development. 

(ii) To promote the discovery of new knowledge 

about the learning process. One quarter of 
the Bureau's funds would be allocated to 
this mission, which involves nly the Re- 
search component of R&D . 

(iii and iv) To disseminate knowledge relevant 

to the improvement of educational practices, 
and to support institutions designed to do 
so. The remaining one quarter of the Bur- 
eau's funds would be allocated to these two 
missions, which would include the ERIC 
system. 

(v) To get results of the four previously de- 
scribed missions into the hands of people -- 
principally school superintendents and 
teachers — who can put these results con- 
structively into classroom use. There are 
no funds allocated to this mission. It must 
be presumed that the mission will be accom- 
plished through exhortation to other organi- 
zations (such as the various State Depart- 
ments of Education and other U.S. agencies 
which are more impact minded) , through the 
provisions of more funds by Congress for 
this specific mission, or through the dilu- 
tion of funding of the other missions which 
the Bureau considers to be crucial. 

’Vs has been noted, the statement of management stra- 
tegy as outlined above was approved by the Research 
Advisory Council in early 1969. It was the latest 
available statement when the great bulk of the ma- 
terial for this report was gathered, and it reflected 
a considerable evolution of management strategy (as 
has also been noted above) from concentration on the 
support of scientific inquiry -- the discovery of 
new knowledge — towards a programmatic approach 
which emphasizes steps towards delivering research 
output to the classroom. 

However, the statement was approved prior to the re- 
cent reorganization of the Bureau of Research, and 
prior to the new Commissioner's announcement that 
one purpose of the reorganization will be to "get 
the good, new ideas into practice -- and to get them 
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there quickly”. Consequently, it can be expected 
that the evolutionary process will be speeded up, 
and that financing priorities will be changed. 

It was apparent from the interviews conducted in 
the course of the investigation -- and also from 
much of the literature — that any change in the 
direction of showing concrete results of research 
activity would be more than welcome to the personnel 
of the Bureau of Research and to the people whom 
they sponsor. This is amply demonstrated later in 
Chapter IV and its supporting Appendices. However, 
it is clear that the effort to "get the good, new 
ideas into practice" quickly will run into diffi- 
culties. Chief among these will be the problem of 
opening up effective lines of communication between 
the R&D community and the ultimate users of their 
output. This, too, is amply demonstrated in Chapter 
IV. However, a related difficulty will be to over- 
come the apparent self image of many educational re- 
searchers, most of whom are members of the academic 
community tending to prefer to communicate with their 
peers rather than with practitioners in the school 
system. Sections of Chapter ill bear out this obser- 
vation. It does not contradict the impression that 
many researchers would welcome seeing their findings 
put into practice. They appear to feel however that 
this is a joo for others. 

3 . Pi ssemination 

The major dissemination activity of the Bureau of 
Research is its sponsorship of Educational Resources 
Information Center (ERIC). This is a massive under- 
taking through which abstracts, microfilms, micro- 
fiches; and/or hard copies of practically all signi- 
ficant reports or other publications relating to edu- 
cational study are made available to the public. 
Nineteen ERIC Clearing Houses (mostly University 
based) located throughout the country retrieve, ab- 
stract, and otherwise prepare material for Central 
ERIC processing. All items are indexed and cross 
indexed, and the indices are brought up to date per- 
iodically through an ERIC publication, Research in 
Education . Thus, anyone interested in a particular 
aspect of education has ready access to a current 
listing of most of the relevant literature, and the 
means to acquire copies. 

All research reports made unoer the sponsorship of 
the Office of Education must (unless exception is 
granted) be prepared for inclusion in the ERIC sys- 
tem. (This is the only requirement with respect to 
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publication which is made of grantees by the Bureau 
of Research. ) 

With one exception, no other dissemination activities 
are sponsored by the Bureau of Research, The excep- 
tion is that some of the Regional Educational Labora- 
tories engage in dissemination activities with 
Bureau of Research funding. Of course, grantees of 
the Bureau can, and do, disseminate their research 
results on their own, usually through conferences, 
journal articles, or other publications. 



THE NATIONAL SCIENCE FOUNDATION 
1. General 

The National Science Foundation has a very broad 
legislative mandate to support scientific research, 
scientific education, and the dissemination and 
application of scientific knowledge. Without ques- 
tion the Foundation owes its existence and its size- 
able budget (approximately $500 million annually) 
to the revolutionary scientific developments of the 
past three decades, to the rapid and continuous 
changes in technology accompanying these develop- 
ments, and to the recognition that positive Federal 
support is necessary to maintain American scientific 
excellence. Most of the Foundation's funds are de- 
voted to the support of basic scientific research 
and facilities, and for institutional support related 
to scientific research. Only about one-fourth of 
the funds are classified as being in support of 
scientific education. These are used principally 
for the finance of advanced study institutes for 
scholars and teachers of science, for individual 
fellowships and traineeships, and for improvement 
of teaching facilities. 

It would be very difficult, if not impossible, to 
determine the extent to which NSF-financed research 
has a potential affect on educational practices, and 
hence could somehow be ^classif ied as educational R&D , 
at least in retrospect. Obviously, the discovery of 
new knowledge and the adaptation or invention of 
novel technologies will have (as they have had) pro- 
found consequences for both educational goals and 
practices. However, only a relatively small NSF 
program is regularly classified as educational R&D . 
This is the program of science course-content 
improvement. 
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The science course-content improvement program 
(CCIP)l was inaugurated when Foundation officials 
recognized that both the subject matter and the 
teaching methods in science courses in most American 
schools had become obsolete as a result of same 
factors which were responsible for the existence of 
the Foundation itself -- the rapid and continuous 
advances in science and technology. Substantial 
changes were thought to be desirable in teazling 
materials and teaching practices, and these changes 
should entail not only updating in order to take 
account of new "facts'", but also emphasize improve- 
ment of learning capacity so that the student would 
be able to absorb the additional "facts" that were 
being uncovered so rapidly. 

Funding (obligations) for CCIP since 1959 have been 
as follows: 



Fiscal Year 



Net Obligations 
( 000 ) 



1959 

1960 

1961 

1962 

1963 

1964 

1965 
3 966 

1967 

1968 

1969 



$ 6,030 
6,299 
6,411 
8,990 
12,632 
13,976 
14,552 
15,564 
18,355 
19,352 

13,300 (est.) 



2 . Mc inagement Strategy 

The CCIP* first started at the high school and 
junior high school xevel. It since has been ex- 
panded to include undergraduate teaching, ana -ary 
recently to the elementary grades. 



The curricula included are in the mathematical, physical, 
biological, medical, social and engineering sciences. Inter- 
disciplinary projects have also been approved, most notably 
to the American Association for the Advancement of Science 
for the production of an elementary school science program 
( Science -- A Process Approach , Grades K-6) which is now 
being used by an estimated 1.6 million school children. 
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A major management principal has been to give sup- 
port to a number of CCIP projects in the same field, 
rather than trying to develop a single approved me- 
thod of teaching each subject* However, before they 
are approved, all projects must undergo rigorous 
screening by outside panelists and committees to 
make sure that they hold out promise for course- 
content improvement generally in line with expert 
opinion as to the desirable direction of pedagogical 
change. The participation of highly qualified per- 
sonnel, both in the field of education and in the 
relevant scientific field, is required. 

A second principle is aim for the development of 
new methods and materials which can be used (or 
easily adapted for use) in schools of diverse char- 
acteristics. In this c mnection, emphasis is given 
to the ease of adapting methods and materials so ns 
to avoid stereotyped "packages” . 

After a project has been approved, the Foundation 
tends to give the project personnel a relatively 
free hand. The principle here is very much like 
that of most private foundations (see Chapter II) : 
once qualified people have been authorized to go 
ahead on an approved project, there should be a 
minimum of monitoring by the sponsor on the grounds 
that the project personnel are, almost by definition, 
the ones best qualified to manage their research. 
Another reason is that the Foundation wants to avoid 
the appearance of a Government stamp-cf-approval on 
the finished product, which might be the case if 
work in progress were too closely supervised. 

Dissemination 

Of all the Federal agencies sponsoring educational 
K&D , the Foundation is the most insistent that pro- 
ject proposals contain adequate provision for dis- 
semination of results. Researchers are encouraged 
to submit frequent progress reports designed for 
distribution to others in their field. Foundation 
funds may be used for this purpose, but actual dis- 
semination is the responsibility of the grantee. 

With respect tc finished materials (texts, manuals, 
equipment, etc.), the project proposal must detail 
the intended procedures for copyright, publication, 
distribution, etc. At this ultimate point, the 
Foundation will not provide funds to promote use or 
adoption, but it will insist that the grantee's 
procedures facilitate public access to the output. 
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The provision in project applications that plans 
must be detailed through to the stage of ultimate 
delivery to the intended target audience — which is 
usually students -- demonstrates the Foundation's 
interest in putting its sponsored-research output to 
work as soon as possible after the results are judged 
to be professionally acceptable. 



THE OFFICE OF ECONOMIC OPPORTUNITY 

1 . General 

Like the Bureau of Research, the Office of Economic 
Opportunity is being reorganized. However, in con- 
trast to the probable outcome of the reorganization 
of the Bureau of Research, it does not appear likely 
that the major thrust of the educational R&D effort 
of the 0E0 will change directions, nor does it appear 
that there will be any qualitative change in the re- 
lationship of R&D to the operational programs of 
the agency. 

Educational R&D sponsored by 0E0 is aimed squarely 
at the objective of improving those operational pro- 
grams of the War on Poverty that have to do with edu- 
cation: Head Start, Follow Through, and the compen- 

satory educational components of th Community Ac- 
tion Programs. On the whole, these programs are 
outside the conventional formal school system — 
hence the word "..ompensatory 11 to describe them. How- 
ever, the results of the research obviously have a 
bearing on the operations of the formal system, which 
is more and more becoming concerned with the educa- 
tional problems of the same disadvantaged groups 
that are the "clients" of OEO's educational programs. 
More important for the purposes of this report is 
the extensive use made by 0E0 o* demonstration and 
experimentation as a research technique, with a view 
towards rapid replication of successful experiments. 

Funds allocated to educational R&D in fiscal year 
1969 amounted to $14.3 million. 

2 . Management Strategy 

The two most important characteristics of the 0E0 
management strategy are (a) that sponsored research 
is operationally oriented, and (b) that heavy re- 
liance is placed on the demonstration and experimen- 
tation technique. 
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a. Operational Orientation 

Operational orientation of educational R&D is 
assured by the structure of the OEO organization 
and its budget allotments. The Division of 
Research, Plans, Programs, and Evaluation (RPP&E) 
nominally has responsibility for all research 
activities. However, the funds controlled ex- 
clusively by RPP&E are fairly small ($2.5 to 
$3.0 million annually), and are used only for 
demographic surveys, not for educational R&D. 

The educational R&D funds are allocated directly 
to the operating programs 1 and can, therefore, 
be used only for projects which are considered 
to be useful by the administrators of the pro- 
gram concerned. 

RPPSE 1 s formal responsibility is to see to it 
that funded projects are v,ell designed and will 
be competently executed. In fact, however, 
there is close cooperation between RPP&E and 
the program administrators in the development 
of research projects. Thus, furtherance of pro- 
gram objectives becomes the chief criterion in 
the allocation of R&D funds. 

b . Demonstration an d Experimental >n 

In a general sensed there is nothing novel in 
the use of demonstration and experimentation 
as a research technique. However, the OEO 
system goes beyond most demonstration and experi- 
mentation in three very important ways: (1) the 

experimental situations are deliberately designed 
with a view to discovering alternative means of 
dealing with compensatory education problems 
under diverse sets of circumstances f (2) several 
different experimental models are tested simul- 
taneously, with the elements of all of them com- 
bined covering as many discrete variables as 
possible, and (3) a major criterion is the poten- 
tial of widespread replicability either of the 
experimental situation itself, or in the form of 
a composite of elements drawn from varioi j experi- 
ments . 

In essence, this involves the establishment of 
numerous "laboratories", but laboratories from 
which there can emerge a number of solutions to 



^In fiscal 1969: Head Start, $6.0 million? Follow Through, 

$4.3 million; Community Action Programs, $4.0 million. 
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variations of the same problem. IL would appear 
to be a reasonable technique wherever new or 
unique situations exist which may have replica- 
tion value. 



BUREAU OF EDUCATION FOR THE HANDICAPPED 
1 . General 

The Bureau of Education for the Handicapped was in- 
augurated in January 1967, as required by Public 
Law 89-750, which mandated a separate Bureau in 
USOE to deal with the problems of educating handi- 
capped children.^ The Bureau inherited functions 
that had previously been performed by other organi- 
zational units in USOE (including the Bureau of Re- 
search), but with a broader mandate and a larger 
budget . 

The mission of the Bureau, in brief, is to provide 
the best possible educational programs for handi- 
capped children by facilitating delivery of educa- 
tional instruments to the site of instruction. Thus 
it is implementation-oriented, an orientation which 
necessarily influences the strategy of its educa- 
tional R&D activities. 

The Bureau's ultimate target group is some 5 million 
children (roughly 10% of the nation's children) who 
are considered to be "mentally retarded, hard of 
hearing, deaf, speech-impaired, visually handicapped, 
seriously emotionally disturbed, crippled, or other 
health-impaired children who by reason thereof re- 
quire special education" (the language is part of 
the basic legislation) . Of these 5 million, at least 
50% are considered to be mentally retarded, or suf- 
fering from speech defects. 

Inasmuch as several other Federal agencies also are 
concerned with problems of the handicapped, the ques- 
tion of overlapping or competition in effort naturally 
arises. In this case, the question can be quickly 
disposed of: the Bureau takes the handicapped condi- 

tion as given data, and aims its programs towards 
educational practices which will help to cope with 



^Only one program of the Bureau has relevance to education 
for handicapped adults. This is the Captioned Film Program, 
under which instructional and other films produced with only 
a sound track are captioned so that they will be available to 
the deaf. 
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the handicaps. The other agencies (principally 
those associated with the National Institutes of 
Health) are primarily concerned with learning the 
causes of handicapping conditions so as to reduce 
their incidence (e.g., studies of pre-natal and early 
childhood nutrition as related to mental deficiency 
in later life) , or with discovering better thera- 
peutic means of alleviating the consequences of handi- 
capping conditions (e.g., hearing devices, prosthe- 
tics, 3 tc ■ ) • The line between these two major con- 
cerns is sometimes blurred, but good interagency 
communications tend to keep the line as sharp as 
could reasonably be expected. 1 

2 . R&D Resources 

In the current fiscal year, the Bureau has $15 Tril- 
lion appropriated for support to educational R&D . 

This is a spectacular increase over the funds avail- 
able in earlier years. In 1964 funds were speci- 
fically allocated to educational R&D for handicapped 
children for the first time. 2 



Funding since then has 

FY 1964 
FY 1965 
FY 1966 
FY 1967 
FY 1968 
FY 1969 



increased as follows: 

$ 1 , 000,000 

2 , 000,000 

6 , 000,000 

8 , 000,000 

11 , 000,000 

15,000,000 



Bureau officials say that although they were hard 
pressed to spend $1 million usefully in 1964 cn edu- 
cational R&D, they now find that H5 million is in- 
adequate. The Bureau's National Advisory Committee 
agrees. However, without judgment about the adequacy 
of fund'. , it is useful to relate the magnitude to 
some other indicators: $80-90 million to the USOE 

Bureau of Research, which is concerned with all levels 



^In its latest annual report, the Bureau - ional Advisory 
Committee made special note of its pleasu.o ’’that the Bureau 
has adopted a policy to integrate and correlate its planning 
with other agencies...." The interviews conducted in the prep- 
aration of this report indicate that there is in fact a high de- 
gree of informal, as well as formal, integration of effort with 
respect to R&D activities. 

2 This was prior to the establishment of the Bureau. The rele- 
vant R&D activity was then in the USOE Bureau of Research, and 
was funded under the Cooperative Research Act. 
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and aspects of education; roughly $17 million allo- 
cated for educational R&D by the Office of Economic 
Opportunity, which has the ultimate objective of 
eradicating poverty? approximately $13 million to 
the National Science Foundation in FY 1969 for cir- 
riculum development, and perhaps the same magnitude 
as the expenditures by all of the major private 
Foundations on educational R&D. The comparisons 
are not intended to be invidious. They may well 
indicate a shortage of total funds for educational 
R&D, rather than an imbalance in fa^or of the 10% 
of the children who are classified as handicapped. 

The figures also show how Che overall strategy of 
Federally supported educational R&D is strongly in- 
fluenced by the Congressional attitude towards par- 
ticular problems. Thus, much of the educational 
R&D strategy emerges as a suramation of individually 
considered segments, rather than as as assignment 
of priorities within a well-defined educational R&D 
set of goals. 

. Management Strategy P r ocedures 

As has been indicated above, the Bureau is implemen- 
tation-oriented. According to the guidelines issued 
by the Bureau to applicants for research support, the 
Bureau "is generally seeking solutions to pressing 
educational problems as they relate to handicapped 
children. It is important for applicants to identify 
the particular problem for which they are seeking 
solutions. While individual research efforts do not 
often result in solutions to major problems, they may 
bring such solutions closer. It is important that 
applicants indicate how the attainment of goals of a 
particular project will be an important step leading 
to the solution of the indicated educational problem". 

There is very little room here for "basic" or "con- 
clusion-oriented" research. Instead, the Bureau 
wants to support R&D activities which promise defin- 
able, early, and practical results. For this reason, 
the Division of Research (which administers the 
Bureau. 's research funds) is an operating arm of the 
Bureau. Its research support is aimed at delivering 
to the other divisions of the Bureau proved and oper- 
ational educational techniques that can be put into 
practice . 

Research grants are awarded to states, state or local 
educational agencies, public or non-profit private 
institutions of higher learning, and other private 
or non-profit agencies for "research, research train- 
ing, surveys, or demonstrations in the field of edu- 
cation of handicapped children...." (The quotation 
from the basic legislation.) There is no restriction 
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on ths types of activities which may be supported, 
so long as they are related to education of handi- 
capped children. 

Prior to the award of grants there is a required 
review of proposals by an expert panel of people 
who are not full-time Fereral employees. This re- 
view is limited to consideration of the scientific 
excellence of the proposal, and to the capacity of 
the proposer (or his institution) to carry out the 
proposed research successfully. Unlike the case with 
some other Federal agencies (notably the National 
Institutes of Health), the Bureau is not required 
to turn down proposals if they are disapproved by 
the panel; however, in practice it does. Proposals 
may be generated in-house, or may be unsolicited. 

In any case, the total prospective funding for pro- 
ject proposals approved by the panels always exceeds 
the budgeted funds. Consequently, in the process of 
fitting the budget to the possibilities represented 
by the approved projects, the Bureau staff is in a 
position to shape the research program. 

The Bureau's National Advisory Council is created by 
statute? it has only advisory powers under the law. 

In practice, the Advisory Council is a vigorous pro- 
ponent of the Bureau’s objectives. The emphasis of 
its actions and reports has been to support the Bur- 
eau, rather than to guide it -*• which is another way 
of saying that the Council has been satisfied with 
the Bureau's operations, but believes that the level 
of its financial resources is inadequate, and that 
the absence of assured funding from year to year is 
inhibiting. Thus, the Advisory Council, as an advo- 
cate rather than a watchdog, strengthens the control 
of the Bureau staff over its program. 

The orientation towards implementation — towards 
delivering services to the ultimate target group of 
handicapped children -- means that the research ac- 
tivities supported by the Bureau (through its Divi- 
sion of Research) approach more closely than those 
of any other Federal agency in this field to the 
activities of the Agricultural Extension Service. 

As has been pointed out elsewhere in this report, 
many people concerned with educational R&D believe 
that more emphasis should be placed on implementa- 
tion. The Bureau’s management strategy would be a 
prototype for them. Basic to the management strategy 
is the support, w: th a sizeable proportion of its 
budget, of 14 instructional materials centers through- 
out the nation sen Lng teachers in the field of special 
education, several regional demonstration centers, 
and a number of demonstration projects. 
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NATIONAL INSTITUTE 07 CHILD HEALTH AND 
HUMAN DEVELOPMENT (NICFD ) 1 

1. General 

This is the youngest Institute in the National In- 
stitutes of Health (NIH) complex* It was established 
in 1963. 

Its rather breathtaking m; jsion, as described in one 
of its publications, is "to help individuals achieve 
a normal healthy life from conception to death. 

Through the conduct and support of research and 
training in the biological, medical, behavioral, and 
social sciences, this Institute fosters efforts for 
acquiring new knowledge and deeper insight into the 
health problems and requirements of mothers and 
children, and into the processes of human life and 
the development of all individuals throughout their 
life span". 

The Institute has an annual budget in the neighborhood 
of $50 million to accomplish this mission. Except 
for a relatively small amount needed to cover admin- 
istrative costs and to support a few in-house research 
projects, the funds are used to support outside re- 
search and training projects and programs in five 
categorical fields: Reproduction and Population 

Research; Pre-natal Biology and Infant Mortality; 
Growth and Development? Adult Development and Aging? 
and Mental Retardation. 

Obviously, none of these categorical fields is ex- 
clusively directed towards research and development 
activities pertaining to education. On the other 
hand, some activities in each of then can be identi- 
fied as relevant to education. At the request of 
the President's Science Advisory Committee, the In- 
stitute made an analysis of its funded projects, and 
concluded that projects funded for approximately $10 
million -- or one-fifth of its budget -- would fall 
into this rubric. 

There can be no question about the Institute's in- 
terest in directing a substantial fraction of its 
resources to educational research and development, 
nor about its concept of "educational" as embracing 
the individual's entire environment and beinq rele- 
vant to his entire life span. The following 



1 The resource management of the National Institute of Mental 
Health is almost identical to that described for the NICHD. 



O 

ERIC 



18 



30 



quotations, taken (not out of context) from the In- 
stitute's presentation to the President's Science 
Advisory Committee, illustrate this: 
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"..•(The) basic mission is to foster, conduct, and 
support research and training in the processes of 
human development -- which includes the learning 
process. ...The ultimate aim of the research is to 
promote a nation of individuals who will be able to 
achieve and maintain the optimum in physical, intel- 
lectual, and social health throughout continually 
productive lives." 

"The NIC HD is not primarily involved in the tradi- 
tional kind of educational research per se. Rather, 
the Institute is concerned with unravelling those 
basic bio-genetic and environmental processes by 
which individuals not only successfully adapt to 
societal demands, but also achieve the higher forms 
of cognitive learning and abstract reasoning." 

"The NICHD is concerned with learning across the 
total life span — whether the learning takes place 
in the crib, in the home, in educational institutions 
or in a factory. Much of the traditional educational 
research has concentrated on the school age years — 
from 5 to 18. Our concern extends backward and for- 
ward in time -- from the newborn through to the aged." 

2. Pr ogram Pla nning 

It would be misleading to suggest that NICHD has a 
"program" of support for educational research and 
development in the sense that the term program is 
normally used. There are several reasons for this, 
the first being the fact, as stated above, that edu- 
cational research and development is not one of the 
Institute's five categorical fields of interest. 

Thus (as is the case with most of the private founda- 
tions) support for educational R&D is a by-product 
of support for other interests. The second reason 
is that, in keeping with the research support policies 
of all of the National Institutes of Heu ~h, and in 
contrast to the policies of other Government agencies, 
support is given over a very wide range of possible 
projects, with the chief criteria (other than avail- 
ability of funds) being scientific excellence and 
relevance to the Institute's extremely broad mission. 




The third reason is the most compelling. This is 
the method used by NICHD (and the other Institutes) 
in selecting those project proposals which it will 
support. The method involves three steps: 

a. There is an initial review by a relevant committee 
of scientists to determine the investigator's 
competence in the proposed research area, the 
adequacy of available research facilities, the 
relationship of the budgetary estimates to the 
proposed research, and the overall significance 

of the project relative to research needs. 

Many such committees exist, each dealing with a 
particular scientific specialty. Each committee 
may also act in a similar review capacity for 
other Institutes. 

b. There is then a final review of the recommenda- 
tions of the study committee by the National 
Advisory Child Health and Human Development 
Council (NACHD) to determine its relevance to 
the Institu e's policies, program needs, avail- 
ability of funds, and scientific merit. No re- 
search grants are made without the approval of 
the Council. 

NACHD is composed of outside scientists and sev- 
eral lay people. The Council meets three times 
a year. One of its principle jobs is to match 
the review committee’s recommendations with the 
availability of funds. (In FY 1968, the Insti- 
tue ’ s budget was sufficient to fund only a little 
more than half of the projects approved by the 
review committees.) 

c. The review committees will have rated their pro- 
ject proposals on scale that is uniform for all 
committees, according to desirability. These 
ratings -- perhaps from a dozen or more committees 
acting independently -- are then put through a 
mechanical process in the NIH Division of Re- 
search Grants, by which the approved project pro- 
posals are ranked according to the review com- 
mittee ratings, and a "Pay Line" is established 
when the cost of the higher-ranked project pro- 
posals exhaust the available funds. 

It is what the NACHD does in the way of manipu- 
lating ratings around the Pay Line, and the 
extent to which the NACHD staff can influence 
the Council’s decisions, which determines the 
research "program" for NICHD. 



This procedure is common to all Institutes in 
the NIH complex. It has met with some criticism 
(with respect to HIH in general, but not neces- 
sarily with respect specifically to NICHD) chiefly 
on the grounds that the conglomerate of the ratings 
by several committees makes the ranking of the 
project proposals suspect. For example, a "hard” 
committee might tend to give consistently low 
ratings , while a "soft" committee might tend to 
give consistently high ones, with the result that 
the "hard" committee's good project proposals will 
be ranked below the "soft" committee's mediocre 
ones. There is also a fear that some of the NIH 
Councils (again, not necessarily the NICHD) are 
less meticulous than they could be in manipulating 
rankings around the r, Pay Line" so as to produce 
a more coherent, relevant, and balanced research 
effort. 

This is not the place to evaluate these criticisms. 
However, it is relevant to note that the system 
makes it extremely difficult for NICHD to focus 
on a few selected problem areas vrithin its broad 
domain. This is especially true because all of 
the project proposals that go through this process 
are unsolicited, and the funded unsolicited ac- 
count for 90% of the budget for activities which 
have been identified as being relevant to educa- 
tion. The other 10% is spent on staf f -generated 
M contracts f ’ and on in-house research. 



3 . Development and Dissemination 

The main target group for NICHD is other scientists. 
There are no grants made for development activity. 
However, there is fairly wide dissemination of re- 
search results through conferences and publications. 

4 . The Future 

The above paragraphs are descriptive of RAD manage- 
ment strategy and procedure at present. There are 
indications that a move away from them -- at least 
slightly away -- will be made. Specifically, arrange- 
ments have been made for the establishment of sev- 
eral university-based research centers. One group 
of centers will deal with mental retardation. These 
centers have been funded but are not operational. 

Just what relevance they will have to educational 
research and development remains to be seen. How- 
ever, the fairly large funding involved suggests a 
move in the direction of greater programmatic 
activity . 
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THE STATE DEPARTMENTS OF EDUCATION 



On this subject# SUCCB Interim Report (February, 

1969) stated: 

"The sampling of State Departments of Education 
was very small (9), but it showed a startling 
variation not only in the amount of resources 
devoted to R&D, but also in the conception of 
what educational R&D is all about. In view of 
the fact that the states now control nearly all 
of the Title I and Title III projects, and will 
soon control all of them, the State Boards of 
Education are potentially a very important 
focus for research based on the evaluation of 
projects in being, and for the planning and in- 
stallation of projects designed specifically 
as "laboratory" subjects. This is not being 
done by most of the State Boards whose per- 
sonnel were interviewed. It would seem that 
a great potential for fruitful research is 
being ignored. However, at this point in the 
study no conclusion except that more should 
be known about the research activities of the 
State Departments can be reached. 11 

There is a little that can be added tc . There 

is not much additional information th : “* hi 1 d per- 
mit further generalizing. Furthermore, s sequent 
to the submission of the interim report, the Office 
of Education has solicited proposals fo': .in exten- 
sive study of the R&D activities in th states -- 
a study which is long overdue? the lair- or.e was 
made in 1964 , and dealt with condition . *.'h pre- 
dated the upgrading of educational res.-*. 1 i ^ n 1965. 

If such a study is now under way, it v;.,u e pre- 
sumptious to anticipate its results wj small 

amount of information gleamed by a SUKC : nu- in a 
relatively superficial survey of only Ft cite 

Departments of Education, plun the bi ; v _ forma- 
tion that were gathered from other int- ” ev-’s and 
from the literature. 

Nevertheless, one conclusion is apparent This is 
that under Titles I and III of the ESFA Slates 

are conducting classroom programs at lea^i. ;one of 
which should be susceptible of eval U3 i y USOii 

in terms of full or modified replical i\: to other 

schools with similar problems. By "cv mion" here 
the term is not used in its usual sens. as a post- 

audit of a program 1 s progress in relalv to what 
v/as originally expected. V'hat is men .' 'other, is 
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an evaluation of what has actually happened in pro- 
grams, with a view to adapting the best features of 
similarly oriented programs to school problems which 
exist elsewhere. 

To put it more succinct ly , there is in the Title I 
and Title III projects an opportunity to learn from 
experience. This would be the kind of research 
which, as has been pointed out above, as being spon- 
sored by the Office of Economic Opportunity, and 
which could result in spinoffs which would help to 
get new ideas into practice. 

Such an opportunity should not be missed. It appears 
clear from very limited contacts with State Depart- 
ments of Education that not all of them would coop- 
erate fully with a USOE undertaking of this sort. 

But it also appears clear that some of them would. 

As a guess, these would be, at least, the State 
Departments in New York, New Jersey, Pennsylvania, 
Minnesota, Wisconsin, Oregon, and California. Others 
might also join in. The point is, much could be 
learned if only a few of the States would agree to 
cooperate by making their Title I and Title III pro- 
jects the objects of USOE research with respect to 
replicable characteristics of projects. There is 
no need, for this limited purpose, to have USOE con- 
trol over the Title I and Title III projects. All 
that is required is some -- . ot universal -- State 
and Federal cooperation. 



CHAPTER II 



SPONSORS OP EDUCATIONAL R&D — THE FOUNDATIONS 



The private foundations are no longer a major source of funds 
for educational research and development projects. In terms 
of annual outlays, their activity is dwarfed by that of the 
Federal agencies. Although precise figures cannot be com- 
piled/ a reasonably well-educated guess would be that the 
foundation grants for educational R&D run in the neighborhood 
of $15 to $20 million, as compared with expenditures in ex- 
cess of $150 million a year by Federal agencies. 

Nevertheless, the foundations are important sponsors. As a 
rule, they can (and do) finance projects which have more of 
a risk element than the Federal agencies are willing to con- 
tend with. They also have fewer inhibitions about subject 
matter. Finally, and perhaps most important, they are more 
willing than the Federal agencies to sponsor outright 
experimentation . 



GENERAL COMMENTS 

With respect to the management of their total resources {i.e., 
in deciding as to what areas of activity to support; what 
specific activities to support in each area; how projects in 
progress should be monitored; and how much support should be 
given to dissemination and implementation), the foundations, 
as a group, are relatively homogeneous. Except as noted in 
the following subsections, the general pattern is as follows: 

1. The foundation decides on a broad area of concen- 
tration, or as is the case with the larger founda- 
tions, several broad areas. The decision-making 
body is the hiqhest governing body of the founda- 
tion, usually a board of directors. 

In the larger foundations, considerable profes- 
sional staff work goes into preparation of back- 
ground material relating to alternatives for the 
board's consideration. This material is, of course, 
distilled by the staff of the foundation, and is 
usually presented to the board by the president in 
several stages, a process designed to successively 
narrow the range of alternatives until a satisfactory 
set of objectives emerges. The staff work and the 
president's recommendations carry a great deal of 
weight, of course, but at this level of decision the 
bo^rd usually takes a very active pa^t, with board 



members making their own proposals to the president 
and tne staff, and debating the merits of alter- 
natives in a process which might last for many months 
What ^merges is, in effect, a self-created charter, 
or mandate, which can be amended only by the board, 
and which clearly lays out and limits the purposes 
for which the foundation funds can be used. 

In the smaller foundations, the procedure is likely 
to be less elaborate, but there is essentially the 
same outcome: a seif-created and self-limiting charte 
which carries the authority of the highest governing 
body, and which can be amended only by that body. 

In all foundations there may be another limiting fac- 
tor in the terms of the bequest, or other funding, 
through which the foundation was established. For 
example, Carnegie Corporation's activities are 
generally restricted to those which further educa- 
tion. The Russell Sage Foundation can operate only 
within the United States. 

The second level of decision-making is to determine 
which specific activities to support within the 
areas of interest as determined by the board. Here, 
the professional staff plays a more decisive role* 
While in the determination of the "charter * 1 the role 
of the ?'taff is largely advisory to the board, at 
this second level a great deal of the actual decision 
making is in the hands of the staff. In the larger 
foundations it is very seldom that the staff recom- 
mendations with respect to projects are not ratified 
by the Board, although the Board usually reserves the 
formal power of veto. The dominance of the staff at 
this level is due to three factors: 

a. The sheer volume of projects which come up for 
consideration is such that, as a practical 
matter, the Board cannot possibly review them 
in detail in any responsible way. 

b. The professional competence of the staff is 
such that projects proposed for approval hr.ve 
already been carefully screened for relevance 
to the foundations purposes, fox* technical 
feasibility, and for competency of the grantee, 
and 

c. the staff members know their board, and will not 
recommend projects which they know would not be 
acceptable . 



3. Almost without exception, foundation support is in 
the form of grants. There is very little monitoring, 
it being assumed that the grantee will do his work 

in a responsible way. Occasionally, however, in the 
smaller foundations the project officer of the found- 
ation will take an active and participatory part in 
the project. 

4. With respect to research projects, the major found- 
ations are seldom interested in carrying them through 
to the development or dissemination stage. An ex- 
ception is the Kettering Foundation, which has an 
active interest in classroom implementation of the 
validated findings which emerge from its funded 
projects. 

For the sake of clarity on this point, it is im- 
portant to distinguish between research projects 
(to which the above generalization applies) and 
demonstration or operational projects. Foundations 
are likely to carry these through to their logical 
conclusion. 

5 . Our investigation has disclosed no case in which a 
foundation includes educational R&D , as such, amon g 
its stated areas of interest ^ However , substantial 
support for educational R&D is given by the larger 
foundations under broader classifications -- e.g., 
Towards Equality (Rockefeller) , Aid to Education 
(Ford) , etc. Some smaller foundations also support 
educational R&D in connection with a single, but 
broader, foundation purpose — e.g., Mental Health 
(Hogg), general aid to schools in Flint, Michigan 
(Mott) . 

The point heie is that foundations do not have a 
method of managing their educational R&D resources 
that differs in any respect from their management 
of all resources. As a rule, they do not even 
classify their projects so as to show educational 
R&D separately. Within a larger field of interest, 
say Aid to Education, projects with an R&D content 
will take their place alongside demonstration , 
operational, general support, scholarship, and other 
projects in the general area of education, all of 
which will be judged on their merits. 
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FORD FOUNDATION 



Policy Formation and Execution 

The Ford Foundation's activities in educational re- 
search and development operate out of a mandate from 
the Foundation's Board of Trustees to support the 
general area of educatin. The guidelines for the 
execution of this mandate were developed by the staff 
in the Education Division. In implementation of 
these guidelines the Foundation supports educational 
programs which are issue-oriented? educational R&D 
is not specifically mentioned. Research projects 
are supported as they relate to the issues identified 
in the guidelines. 

Currently, the guidelines emphasize support in the 
following areas: 

new dimensions of problems in inner-city 
schools (including political, social, 
linguistic) . 

educational problems in areas of the developed 
world. 

preschool and elementary education problems — 
deemphasis on standard secondary educational 
projects . 

emphasis on speeding up the acquisition of the 
Ph.D. in the social sciences. 

no more regular support in the hard sciences 
and engineering. 

The Board of Trustees meets quarterly to review 
and approve division budgets and to review program 
emphasis. The Board periodically reviews lists of 
prospective grants, and specialized committees of 
Board members serve ir advisory capacities to the 
divisions to review recent and prospective grants. 
These activities provide an interaction between 
Board and staff members on how the approved guide- 
lines are being implemented. 



2 . Funding Procedures 



The Foundation attempts to have its "program ofricers- 
in-charge" identified by their specialized clientele 
as the contact persons for the Foundation. This con- 
tact helps provide a high level of interaction between 
the Foundation and its public. All proposals not sent 
directly to these individuals are referred to them. 

Program officers have the authority to reject propos- 
als for funding, but not the authority to approve 
them. When proposals which appear to have promise 
and which are reasonably related to the Foundation's 
guidelines are received, the program officer will 
work with the potential grantee and with his own col- 
leagues and superiors in order to produce an accept- 
able and meritorious project proposal. Ideally, few 
proposals which go through this process are rejected. 
To avoid rejection, the senior officers periodically 
review listings of proposals being considered so that 
questions can be raised at an early stage before a 
great deal of staff time has been devoted or a par- 
tial commitment made to them. 

The initial approval of a project usually includes 
the level of funding and the period of time over 
which funds will be allocated. During the annual 
budgeting process, however, each project is reviewed 
to determine the desirability of continued funding 
and whether or not the promise of the project may be 
fulfilled in the time period originally supported. 

Outside consultants are often brought in to review 
a proposed project* There is no set group. Indi- 
viduals are called in at the discretion of the staff. 
One reservation in the use of experts to review a 
proposal in their own area of concern is the tendency 
on the part of such individuals to encourage Founda- 
tion support of a project in their area. 

Each division in the Foundation receiver a set annu- 
al budget within which it must operate. A portion 
of this budget is put aside until later in the fis- 
cal year in order to fund worthwhile projects as they 
reach the approved stage. Otherwise, all available 
funds could be committed within a short period of 
time. On the other hand, there is no reversion of 
funds to the general budget, so th:^re is no pressure 
to spend funds on whatever projects are available 
in order to be able to use the money or to maintain 
the budget level for the following year. 
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Often attractive ideas are submitted or in some way 
identified for which funds are not available or 
which do not currently have promise. These ideas 
are often tucked away and periodically brought up 
for discussion -- and, many times, eventually 
funded. 

3 . Approximate Funding 

The annual budget for the Education Division is 
approximately $25 million. Perhaps $5 million of 
this could be considered educational R&D. 

4 . F eedb ac k and Evaluation 

The view that foundations just give money without 
interest in the outcome is incorrect in the eyes 
of the Foundation. On the other hand, however, the 
Foundation does not expect rigorous project evalu- 
ation because of the uncertain nature of much of 
what is supported, and hence it is nearly impossible 
to establish pretest or study control groups. The 
"middle-road" view is to try to fight the tendency 
to look for the next step in the development of the 
problem areas before lessons are learned from 
existing projects. Evaluation, therefore, is en- 
couraged in all projects, and staff members are 
assigned to try to keep in continual contact with 
progress being made. 

The continual appraisal of current progress is 
particularly relevant in light of the Foundation's 
attempt to carry out demonstration projects in one 
or two areas and to expand into new areas only as 
new or different dimensions of the general problem 
are identified. This approach differs from a for- 
mer tendency (when more money was available) to 
invest a large amount of money in many approaches 
to a problem or in many locations at one time. 

5 . Tie-In With Other Foundations and the Federal 
Government 

The Ford Foundation does not, and would not, accept 
a cut-and-dried role of filling the gaps in educa- 
tional research and development left by the opera- 
tions of the Federal government. Rather, the 
Education Division tries to keep in close contact 
with the USOE, and many Foundation people serve on 
advisory councils to Federal agencies. The Foun- 
dation feels it can play a significant role in re- 
lation to Federal programs by providing advance 




experimentation in areas where the government might 
become involved but does not yet have lagal author- 
ity and/or staff, and perhaps support projects that 
in some way evaluate Federal programs and, hence, 
are best handled by an outside entity. The Founda- 
tion carefully tries not to support programs that 
the Federal government is already supporting or is 
capable of supporting. 

The Ford Foundation also looks carefully at what 
other foundations are doing not only to keep current, 
but to avoid duplication and also to collaborate on 
projects of joint interest, e.g., implementation of 
the Kerr Commission recommendations and the support 
of ETV workshops. 



CAFNEGIE CORPORATION OF NEW YORK 

1 . Policy Formation and Exec u tion 

By charter, the mission of the Carnegie Corporation 
of New York is to aid education. While the problems 
and issues upon which it focuses vary and change over 
the years, the projects it supports either deal with 
problems related to education or with the utilization 
of education as a means for the solution to tne prob- 
lems. Also by original charter, a large portion of 
the projects supported are in the United States with 
the remaining {about 5 or 6%) in the British Common- 
wealth countries. 

Currently, the major areas of Corporation interest 
are: higher education, education in arts and medicine, 
public affairs, preschool education and learning 
theory. These areas are largely determined by the 
particular interests and competence of the eight 
senior professional staff members of. the Corporation. 
While educational research and development is not 
specifically identified as an area of interest, R&D 
types of activities may be supported in any one of 
these areas. For example, in order for the Kerr 
Commission on the Future of Higher Education, sup- 
ported by the Carnegie Corporation, to fulfill its 
task it has, in turn, comniss ioned some 20 research 
projects. The staff is constantly debating how the 
Corporation's funds might Ire most socially useful 
without defining areas of interest rigidly, for 
such a definition might preclude support of good 
ideas that the staff had not thought to include. 
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There is, of course, a generally defined universe 
determined by the interests of the President, Vice- 
President and the Board. The staffs interests 
must, somehow, lie within, or closely be related, 
to that universe . 

The Carnegie Corporation operates a rather informal 
organization. The criteria for decision-making are 
quite flexible, with a few broad restrictions simi- 
lar to those of other foundations. For example, the 
Corporation will not give general support for an 
established program, but will give operating support 
for worthwhile beginning efforts. In addition, no 
money is given to individuals, but if the work of an 
individual is deemed worthy of support, the funds 
are handled through some administrative entity such 
as a university. 

The Corporation is a grant-giving, rather than an 
operating foundation, but it has no program or di- 
visional budget for grants. It provides grants pri- 
marily for direct action and experimental and demon- 
stration projects. Very fev; basic research projects 
are supported directly but receive support as part 
of broader efforts. The Corporation occasionally 
funds major programs like the Kerr Commission, but 
normally provides grants for projects where specific 
results can be seen more easily. 

The function of the Board of Trustees in regard to 
interest areas is to react to the deliberations and 
recommendations of the staff. The Board, then, takes 
a "re-active role" in defining foci of the Corporation 
as they deal with specific recommendations for sup- 
port. The staff will occasionally work with the 
Board to explore trends in a given area where the 
staff feels support should be given and the Board 
is uncertain about the wisdom of such decisions. 

The Board meets approximately four times a year. 

Its Executive Committee meets five times a year. 

One of these groups approves all grants. Those pro- 
jects involving major commitments or new or contro- 
versial areas of interest are brought before the 
total Board. 

Funding Procedures 

Although the Corporation receives many more un- 
solicited proposals than it can support, the staff 
tries to be on the offensive to generate interest 



and proposals in certain areas which they regard to 
be of high priority. Proposals are received direct- 
ly by, or distributed to, staff members to whom 
they might be of most interest. They are disapproved 
directly if the particular staff member does not 
feel them worthy of further review. About one in 
15 passes beyond this initial review, and is then 
sent to the President and Vice-President for determ- 
ination on whether the request is within the realm 
of interest and capability of the Corporation, Upon 
approval in principle by these senior officers, pro- 
posals are distributed for individual staff review 
and then discussed at monthly staff meetings. 

Although most proposals reviewed at the monthly 
staff meetings are deemed worthy of support, funds 
are never adequate to support them all. Therefore, 
priorities are assigned almost entirely on the judg- 
ment of which projects seem to be most crucial and 
the best utilization of Corporation funds. Proposals 
on this priority list, then, may be recommended for 
approval in their entirety, trimmed down in size, 
delayed or entirely disapproved. Those recommended 
for approval are sent to the Executive Committee or 
to the Board for tneir final approval. (The President 
has discretionary powers for grants up to $15,000.) 

The Board rarely disapproves the recommendations of 
the staff, but questions are often raised and, on 
occasion, projects are delayed until the Board's 
questions are dealt with adequately. Approximately 
90% of the proposals submitted by the staff are 
approved "as is" and about 10% will have recommenda- 
tions for revision as a condition of approval. 



The staff uses external readers 
review of proposals in which the 
is limited. There is, however, 
cedure for this readership. Bee 
are active in their own areas of 
few proposals introduce strictly 
If new ideas are received with a 
action, their chance of approval 
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3 . Approximate Funding 

In FY 1968, the Corporation awarded $12,125,000 in 
97 separate grants, of which $700,000 was through 
the Commonwealth program. Twenty-eight of these 
grants, totaling about $5 million, were classified 
as educational research and development activities 
in the U.S. 

4 . Feedback and Evaluation 

Reports are required at least annually for all pro- 
jects being sponsored by the Corporation. In addi- 
tion, staff members keep in continual touch with the 
projects that lie in their area of concern. Also, 
staff members function as commission members on 
some of the major programs, such as the Kerr Com- 
mission on Higher Education, and, in rare cases, 
conduct some of the subprojects of chose commissions. 

5 . Dissemination 

The Corporation has not set policy regarding the 
dissemination of results of the studies and projects 
it supports, nor does it have any policy restricting 
the support of publication per se. Hence, the 
Annual Report lists several books that resulted from 
supported projects. These books were written by the 
grantees and usually published at their respective 
institutions. The Corporation also occasionally sup- 
ports the publication of research and experimentation 
results and theoretical speculation even though they 
did not support the projects themselves. The Corpor- 
ation published a Quarterly Report of interest to 
others in the field of education in which it des- 
cribes selected projects in detail. 

6 . Tie-In With Other Foundations and Federal 
Government 

Although detailed information is not available as 
to procedures for cooperation and cooperative plan- 
ning, evidence is fairly strong through the Annual 
Report that the Carnegie Corporation cooperates 
actively with other foundations and the Federal 
government in the conduct of specific projects. 

There are at least six such projects listed in the 
current Annual Report. They are: Children's TV 
Workshop; the New York Urban Coalition; the New 
York City School Decentralization Study; the Cor- 
poration for Public Br c dcasting; the National 
Citizen’s Committee for Broadcasting, and the 
Educational Development Center. 
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RUSSELL SAGE FOUNDATION 



1 . Policy Formation and Execution 

The Russell Sage Foundation is somewhat unusual 
as compared with the other foundations investigated 
as part of this study. It functions as a combin- 
ation research institute and grant-giving founda- 
tion. Forty percent of its funds are granted to its 
own staff for the conduct of research projects. 

The Foundation itself is somewhat limited in finan- 
cial size, granting approximately $2 million for 
projects in any given year. However, this limited 
size is offset by a large professional staff of 15 
people, all with research qualifications in the 
social sciences. This large professional staff means 
that a great deal of staff time can be devoted to 
the careful review of both the internal and external 
investments . 

The Foundation operates within fairly limited areas 
of interests, largely identified by the staff and 
discussed and approved by the Board. The only re- 
striction by charter, is that the Foundation attempt 
to improve the quality of life within the United 
States. Gradually, the Foundation has attempted to 
implement this charter by focusing on the social 
sciences. The staff has a great deal of discretion 
in the declination and development of proposals 
within the areas that are approved by the Board. 

There are no established program areas, so one can 
only glean from the Annual Report a somewhat ir ex 
post facto" grouping of areas of supported activities 
during previous years. These categories tend to 
change somewhat from year to year as old projects 
are terminated and new projects are begun. Most of 
the research supported by the Foundation is theo- 
retical in nature and little of it is directly re- 
lated to education. 

2 . Funding Procedures 



In a nutshell, the funding procedures of the Russell 
Sage Foundation are that the staff declines and the 
Board approves. All unsolicited proposals not sent 
directly to a specific staff member are reviewed by 
the President and any that fall outside of the cur- 
rent areas of interests of the Foundation are immed- 
iately declined. All the staff members receiving 
proposals carry out the same function on proposals 
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that they receive. Those proposals retained are 
directed to staff members for a thorough review. 

Staff members who wish to have their own research 
projects supported submit proposals in the same 
manner. These proposals are scrutinized more thor- 
oughly because of the desirability of having only 
high quality proposals coming from the staff. Of 
course, the staff has insight into the process of 
obtaining support and thus is able to develop its 
proposals with 'more assurance of approval. Staff 
members propose projects in the areas of their own 
interest, not necessarily those that seem to be the 
current focus of the Foundation. However, the inter- 
ests of the staff do not vary greatly from those of 
the Board, for staff members are selected by the 
Board on the basis of their research interests. The 
Foundation encourages external proposals as well as 
staff proposals becaur^e they feel that good ideas 
can come from either place. 

Because of the high level of capability in the 
Foundation staff, external proposals that seem to 
have seme promise are carefully developed by staff 
members in cooperation with the potential grantees. 
The staff has the authority to decline proposals 
at any stage of review should these developments 
not prove fruitful. None of the declinations are 
reviewed with the Board of Directors. 

Because the Board meets only three times a year, 
the President is provided a limited contingency 
fund through which he can provide grants up to 
$5,000 for those projects needing immediate support. 
However, these grants are rarely for more than 
$1,000 or $2,000. 

Approximate Funding 

As mentioned above, the Foundation's grants total 
approximately $2 million each year. Approximately 
35 projects are supported each year. Forty percent 
of these are in-house research and 60% are external 
grants. Very few of these grants are to support 
educational research and deve lopment , and essen- 
tially none of the projects supported deal directly 
with the teaching-learning situation. 



4 . 



Feedback and Evaluation 



The Foundation’s staff keeps in close contact with 
the progress of the external research being sup- 
ported. At the very minimum, annual reports are 
required, but more often staff members will initiate 
contact with grantees to determine whether or not 
the competences of the staff can be utilized to 
solve problems in the project* The staff evaluates 
the results of projects supported inasmuch as the 
Foundation reserves first rights on the publication 
of the results. All results are evaluated with 
possible publication in mind, and the Foundation 
maintains its own publication program. 

5 . Dissemination 

As mentiu ed, the Foundation has first publishing 
rights. If the staff feels that the results of a 
research project are of high quality and of suf- 
ficient interest to the research community, the 
Foundation will publish these results through their 
own publication operation. 

6 . Tie-In With Other Foundations 

The Russell Sage Foundation has often been called 
the "Foundation’s Foundation." This is due, in 
large measure, to the interest of a former staff 
member in the study of philanthropy, and the 
Foundation’s support of the Foundation Library Center. 
Out of this study has grown the publication of The 
Foundation Directory , now in its third edition. 
However, projects are only occasionally sponsored 
jointly with other agencies or foundations. 



CHARLES F. KETTERING FOUNDATION 
1.. Policy Formation and Execution 



In 1964 the Charles F. Kectering Foundation set 
out to assess the impact of its educational grants. 
Amazed at the almost negligible impact of their 
grants, the staff and Board decided to institu- 
tionalise the application, dissemination, and 
implementation of the resu] of both Foundation- 
supported and other research. As a result, the 
Foundation became an uperating, as well as a grant- 
making organization in the field of education 
through the establishment of the Institute for the 
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Development of Educational Activities. The Insti- 
tute (IDEA) was first a division of the Foundation 
and later an incorporated subsidiary. As a separate 
entity, IDEA can secure grants from external sources 
and is flexible to develop expertise in the areas of 
educational innovation. The existence of the Insti- 
tute with its focus on dissemination and implementa- 
tion sets the educational R&D efforts of the Ketter- 
ing Foundation apart from those of the other found- 
ations studied. 

The Foundation Board is composed of prominent edu- 
cators and business leaders and serves also as the 
Board of Trustees of IDEA. The Board meets every 
six months to approve major directions of both the 
Institute and the Foundation, and to budget funds 
for major areas of activity. From that point on, 
the staff has a great deal of latitude and authority 
in the use of the Foundation's funds and in the se- 
lection of projects to support. All proposals for 
external grants, however, are formally approved by 
the Board of Directors. 

Decision-Mak i n g in IDEA 



The Institute is composed of three semi-autonomous 
divisiows: Research and Development, Innovative 
Programs, and Informational Services. The some- 
what independent nature of these divisions is par- 
tially determined by their location. The R&D Di- 
vision is located at the Graduate School of Education 
at UCLA, the Innovative Programs Division is in Day- 
ton, and the Informational Services Division is in 
Melbourne, Fla. 

The key decision-makers in the Institute are the 
Executive Director and his Administrative Council. 

The Council is made up of the Executive Director, 
the Directors of the three divisions in the Insti- 
tute, and the Institute Program Officer. These five 
individuals review all basic Institute policies, 
identify and agree upon major program thrusts, and 
advise each other on specific divisional efforts. 
While no specific Board members are assigned the 
responsibility for education, the Executive Director, 
who is also Vice-President for Education of the 
Foundation, ^ries to maintain communication with 
members of the Board who have particular strengths 
and interests in education. 



The Institute is evolving into a service agency 
which attempts to help bring about the adoption of 
innovative practices in U.S. public schools. Three 
areas of current focus are: early childhood, elemen- 
tary education, and secondary education. Within 
these areas, IDEA is attempting to develop expertise 
about those innovations that might have the greatest 
impact on the total educational program of a school 
district . 

The functions of the R&D Division are primarily 
surveying the state-of-the-art of educational change 
and conducting experiments involving new ideas in 
several cooperating and demonstration schools. The 
Division does not conduct basic research, but at- 
tempts to identify some of the gaps in basic re- 
search related to innovation. Research in these 
areas might then be supported through external grants 
by the Kettering Foundation. Some 50% of the IDEA 
staff is employed in this division, and most of the 
staff members are connected in some way with UCLA. 

The Innovative Programs Division provides grants to 
school districts and others interested in education- 
al change. Help is made available to school dis- 
tricts and governmental or private educational en- 
tities upon request. The Division maintains com- 
petence of its own staff in the area of specifications 
for educational facilities (primary focus) and serves 
as an organizing and integrating force to bring to 
bear the resources of a "core of consultants" on all 
of tile educational problems of a particular school 
district. Through the core of consultants, IDEA 
can help a school district to mount a coordinated 
and integrated revision of its entire program. Some 
attempt is being made to multiply the affects of the 
Institute by working with architects and state ed- 
ucation agencies who, in turn, might effect change 
in a larger number of school systems. The cost of 
the consultation service is borne by the school dis- 
tricts themselves while the Foundation underwrites 
the operating and staff costs of the Institute. 

The Information Services Division develops all ma- 
terials for the Foundation, including reports of 
seminars and conferences, working papers supported 
by the Foundation as background for the implemen- 
tation of certain innovations, and a microfiche 
library of elementary science, reading, and social 
studies curricula. The Division also develops ma- 
terial for informing the lay public on the feasi- 
bility of changes in education, and for the 
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in-service training of teachers and administrators. 
The Information Services Division will identify in- 
teresting areas of innovation and will develop ma- 
terial relating to these even though they do not cur- 
rently bear directly on the activities of the other 
two divisions. 

It is expected that as the demand for services in- 
creases, tb i Institute will have to become more spe- 
cialized and restricted because of the impossibility 
of servicing all requests. At that time, IDEA will 
probably provide some clearinghouse function for 
areas in which it does not maintain an expertise, 
and will attempt to focus primarily on those inno- 
vations that have promise of having the greatest 
impact on educational change. 

Funding Procedures 

All requests to the Kettering Foundation for exter- 
nal grants in education are routed through the Vice- 
President for Education (also the Executive Director 
of IDEA) for review. Of all of the external grants 
made by the Foundation, 90% are in the field of ed- 
ucation. Of course, only a few of the requests 
received are actually funded. 

The Foundation has restrictions on the granting of 
support, such as: no grants to individuals, no sup- 
port of study-tours, no operating support, and no 
grants for the construction of facilities. All re- 
quests are initially referred to, and reviewed by, 
the Vice-President for Administration. Any that fall 
outside of the Foundation's range of interests are 
turned down or declined by him. Those remaining are 
sent to the Vice-President for Education for review 
by him and his Institute staff. At times, consul- 
tants will be called in to review proposals. The 
decision of whether or not to support various pro- 
jects is based on a loose statement of priorities 
and on the staff's judgment of which projects might 
have the greatest long-range effect and, hence, be 
the best investment of the Foundation's funds. There 
is some tendency to support projects that might be 
closely related to the efforts of the IDEA. All 
proposals received by the Foundation are grouped by 
topic, listed by title and by name of the person 
requesting support, and submitted to the Board of 
Trustees at their semi-annual meetings. At that 
time, a number will be recommended for support and 
the Board usually approves those that are 
recommended . 



4 . Approximate Funding 



In the 1967-68 fiscal year, the Kettering Foundation 
provided $5,730,000 in support of its scientific and 
educational activities. Of this total, $'‘,924,000 
was allocated to IDEA for its operation, $44,000 
was allocated for a survey of public attitudes toward 
educational change, the results of which were used 
by IDEA, and $1,841,000 was allocated to external 
parties for the support of educational activities. 

Due to the nature of the Foundation's interests and 
limitations on support, one can assume that a large 
part of this $l,b41,000 was for experimental types 
of activities. 

5 . Feedback and Evaluation 

The internal operation of IDEA is, of course, in 
continual review by the Administrative Council of 
the Institute. At the minimum, annual and terminal 
reports are required with respect to all external 
projects supported. However, some flexibility is 
established and maintained with each project so that 
frequent contacts can be maintained if such are 
deemed desirable. The results and conclusions that 
might have been reached through any of the external 
projects are carefully reviewed by the Institute 
staff to determine their possible utilization as 
part of the on-going IDEA activity. 

6. Dissemination of Results 



The on-going activities of the Institute are pub- 
lished and disseminated in two major ways. A 
quarterly newsletter is distributed to all public 
school districts in the country and to many indi- 
viduals in the field of education. This vehicle 
provides brief reports on attempted innovations, 
the results of various experiments, and reviews of 
other publications available from the Institute. 

The other focus is the publications that arise 
from various conferences and experimental programs, 
working papers, and the result of external projects 
supported by the Foundation. 

In addition to publications, the league of cooperating 
schools (some 20 in number) in Southern California 
and some 35 demonstration schools around the country 
are utilized by the Institute as visiting sites for 
educators interested in observing the innovations 
in practice. 
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7 , Tie-In Wi th Other Foundations and the Federal 
Government' 



Some lines of communication are maintained between 
the Kettering Foundation and IDEA and the other 
foundations interested in educational R&D • Commun- 
ication tends to be in the form of exchanging points 
of view, comparing notes, keeping in contact with 
other staff members, and reviewing annual and other 
special reports of interest. There is no formal 
structure to carry out this communication and the 
foundations tend to keep to themselves until nearing 
completion of a project or a major effort. There is 
some cooperation between Kettering and other found- 
ations on special projects. For example, the Danforth 
Foundation supported, and the Institute organized, 
a recent conference on student revolt and the Ford 
and Kettering Foundations are jointly supporting a 
new effort in the utilization of satellites for 
educational television , 

The Foundation does not cooperate directly with the 
Federal government in cosponsoring activities , but 
attempts to look at the major pieces of Federal 
legislation and their implementation so that they 
might steer away from duplicating activities for 
which public funds might be available, and to iden- 
tify needs that the Foundation might best meet. 



OTHER FOUNDATIONS 

Material for the foregoing sections was obtained in large 
part through personal interviews with officials of the found- 
ations whose activities are described. In contrast, the ma- 
terial in this section was obtained entirely by mai. and 
through documents such as annual reports. 

Seven small foundations are reported on. They were selected 
because of their known interest in education. The seven 
are : 



THE COMMONWEALTH FUND 
THE DANFORTH FOUNDATION 
ESSO EDUCATION FOUNDATION 
THE MOTT FOUNDATION 



THE GRANT FOUNDATION 

LOUIS W. AND MAUD HILL 
FAMILY FOUNDATION 

LILLY ENDOWMENT INCORPORATED 
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1 . Policy Formation and Execution 



The involvement of these seven foundations in the 
field of education varies greatly in both extent 
and nature. The Esso and Hill Foundations are the 
only two that even implicitly identify educational 
research and development as an area of interest and 
specify procedures for its support. However, the 
other five foundations support at least some R&Q 
types of activities as means of carrying out their 
major foci in education. 

The Commonwealth Fund is primarily interested in 
medicine and the delivery of health services. Edu- 
cationally, its interest is in developing new cur- 
ricula for medical educaticn . These areas of inter- 
est and relevant policies are spelled out by the 
Board, often with the use of outside consultants. 

The Fund states no restrictions on the types of 
grants that it will consider; i.e., the Annual Re- 
port indicates that some grants are provided for 
operating and building funds. The Board of Directors 
meets three times a year, with the Executive Commit- 
tee of the Board meeting more frequently to consider 
smaller proposals and those more clearly fitting 
within stated policies and areas of interest. 

The field of education has long been the major 
interest of the Danforth Foundation. It supports 
R&D activities in line with its areas of interests. 
For example, it recently supported a study of the 
future role of private colleges and universities. 

The Foundation recently identified urban problems 
as an area for major emphasis and it will support 
educational activities related to this area. The 
decision to enter this new area was made by the 
Board of Directors, as have similar decisions in 
the past, but the idea was initiated by the staff. 
Such program decisions are often reviewed by outside 
consultants . 

The Danforth Foundation is both an operating and 
grant-making foundation. Approximately one-third 
of its budget goes into its own administration of 
such things as fellowships, grants to individuals, 
and workshops. Areas of education listed as being 
outside of the Foundation's interest are: adult 
education, elementary and preschool education, 
and informal education programs. Also, support is 
not provided for salaries, operating expenses, and 
building. Even though various members of the 
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Danforth family are on the Board of Trustees, the 
Foundation staff regards the organization as a pro- 
fessional foundation and sees the Danforth family 
as taking a decreasingly active role. 

The Esso Foundation's primary interest is the sup- 
port of institutions of higher learninq. It not 
only provides funds for educational research and 
development within this area of interest, but also 
provides support for innovative projects in under- 
graduate education through a program called Support 
for Promoting the Utilization of Resources {SPUR) . 
Grants under this program are limited to $75,000 
per project. The Foundation was founded by and re- 
ceives 85% of its annual income from the Standard 
Oil Company of New Jersey and its affiliates. It 
has a small professional staff that formulates pro- 
gram areas and a standing advisory committee of 
leading educators. The Board meets three times a 
year to review the policies and programs of the 
Foundation, to ratify grants made by its Adminis- 
trative Committee, and to approve grants submitted 
at the time of the Board meeting. 

The major interest of the Grant Foundation is the 
mental health of children. As a part of this in- 
terest, a significant portion of its grant-making 
activity (approximately 40% in FY 1967) was directed 
toward the psychological aspects of education. The 
Board is regarded as the policy and decision-making 
body of the Foundation, but it functions in consul- 
tation with the staff. A preponderance of the 
Foundation's grants are made to agencies in the 
United States. 

The Hill Foundation is interested in science, wel- 
fare, and all levels of education. Many of its 
projects classified as scientific or welfare are 
educational in nature. It long has been interested 
in basic research, but is now giving increasing 
emphasis to applied research and experimentation. 

The Foundation attempts to identify problem areas 
and to support projects in the northwestern portion 
of the United States. The Foundation staff keeps in 
professional contact with educators in the north- 
western region and uses these individuals as in- 
formal advisors and consultants. The Board of 
Directors meets monthly, and works together with 
the staff to determine priorities and guidelines . 



The majority of the educational support provided by 
the Lilly Endowment is giver to selected church 
colleges in Indiana in the form of unrestricted 
annual grants. Rarely are new institutions added 
to the list and grants are not made to individuals. 
The Board of Directors sets policy and continues 
the Endowment as a grant-making foundation. 

The basic area of interest of the Mott Foundation 
is the development and promotion of the community 
school concept. The Foundation's efforts in this 
area are primarily focused in using the community 
school system in Flint, Michigan as an arena for 
innovative solutions to problems arising in that 
area of concern. The Foundation does support uni- 
versity fellowships and regional centers at seven 
universities where some of the lessons learned from 
the Flint experience can be disseminated. The Board 
of Directors establishes the policies and parameters 
in which the staff works. The staff, of course, 
recommends many of these policies to the Board. 
Contact is maintained with outside advisors on an 
informal basis to review policies of the Foundation. 
Most of the Foundation's grants are for the opera- 
tion of programs? those in Flint are administered 
through the Mott program of the Flint Board of 
Education . 

2 . Funding Procedures 

As was typical of the foundations visited, the 
varying funding procedures of the seven reported 
here boil down, in essence, to the adequacy of pro- 
posals being reviewed by staff and final decisions 
being made by Boards of Directors or their repre- 
sentatives. The details of handling and the amount 
of discretion at various levels vary from found- 
ation to foundation. 

The Cor lonwealth Fund regards itself as a typical 
professional foundation. It responds co all verbal 
and written inquiries for support, with inquiries 
of particular interest be. g mentioned at a weekly 
staff meeting. If the st&j.f decides that it might 
be feasible to support the idea, then this possi- 
bility is discussed with the potential grantee and 
he is invited to submit a formal application. At 
times, outside consultants are used to review these 
formal applications. If the staff feels that the 
proposed project would have broad impact in its 
areas of interest and the person or institution in- 
volved is of adequate quality, then, with the 
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President's approval, the staff recommends approval 
of the proposal to Board members two weeks prior to 
their meeting. The Board of the Executive Committee 
approves all grants, with the latter approving 
smaller and more typical proposals. The President 
has a revolving fund out of which he supported 7 
projects during 1967-68 varying in size from $3,000 
- $10,000 each. 

The Danforth Foundation distributes formal proposals 
to staff members working in the areas of interest 
of the proposals. All proposals are reviewed by a 
committee of staff members, and from the committee 
go to the total staff and then to the Board. Pro- 
posals may be rejected at any level — by individual 
staff members, committees, the total staff, or, 
of course, by the Board. The Board is provided with 
a list of proposals declined and brief explanations 
of those declinations. Outside consultants are used 
at times in reviewing proposals where the staff feels 
it competence is limited. The President, staff mem- 
bers, and committees have some discretionary funds, 
but these are reportedly not widely used. On all 
other projects, final decisions are made by the 
Board. 

The procedures of the Esso Foundation are more spe- 
cifically defined than for any other foundation 
studied. Initial inquiries must be in the form of 
a preliminary outline, the specifications of which 
are prescribed in detail. Proposals under SPUR may 
be submitted at only two different times a year. 

The staff reviews the preliminary outlines and de- 
termines which ones seem to warrant further consid- 
eration. The staff reviews the detailed proposals 
requested, sometimes with the advice of outside 
consultants, and the proposals are then reviewed by 
the advisory committee of educators. The staff 
recommends approximately 25% of the detailed pro- 
posals for funding, taking into consideration the 
recommendations of the Advisory Committee. The 
Administrative Committee of the Foundation, made up 
of various officials of Standard Oil Company of New 
Jersey and its affiliates, decides on the majority 
of the grants. The Foundation gives $2,500 
presidential-contingency grants to a large number 
of private colleges each year. These funds are un- 
restricted as to use and are made automatically 
without application. Various capital grants are 
given to private institutions upon application, and 
unrestricted grants aie given to both engineering 
and science departments. 



The availability of information about the funding 
procedures of the Grant Foundation is limited to the 
statements that proposals are mainly unsolicited; 
staff reviews all proposals, using advisors when 
appropriate, and staff makes site visits when deemed 
necessary. 

The Hill Foundation staff prides itself on its close 
interaction with professionals in tne fields of 
education, science, and welfare in its northwest 
region. Therefore, many of its proposals result 
from staff initiative in various conferences and 
discussions. Proposals are evaluated by the staff 
and recommended to the Board. Outside consultants 
are often used on an informal basis? rarely is a 
fee involved. According to the Annual Report, each 
formal request for funds is reviewed by the Board 
of Directors for either declination or approval. 
Approximately 13% of all formal applications are 
approved. The staff has no discretionary funds. 

The pattern of giving by the Lilly Endowment is 
fairly established, but grants given to other pro- 
jects result primarily from unsolicited proposals. 
Occasionally ideas are suggested by the staff and 
result in a formal application. The staff has the 
authority to turn down proposals that are clearly 
outside of the areas of interest established by 
the Board. Occasionally, consultants are used to 
review proposals. Final decisions on project sup- 
port are made by the Board. 

Because the Mott Foundation concentrates its giving 
in the Flint Community School Program, its staff 
has a high level of interaction with those receiving 
its funds. Most proposals, therefore, stern from 
this interaction. Requests for funds are logged by 
the Secretary, acknowledged, and reviewed for their 
appropriateness to Foundation policy. If they seem 
appropriate, they are sent to the Project Director 
for further review. From there they go to the Comp- 
troller, who determines legal acceptability, and 
then to the Executive Director or Assistant Director. 
From there they go to the Foundation President and 
only then to the Board of Trustees. Denial can be 
recommended by any of these individuals at any level 
of consideration, but must be finally acted upon by 
the Board. The Board,, therefore, approves all grants 
and denials. Outside advisors are used only infor- 
mally in the review of program areas and specific 
proposals . 
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3 . Approximate Funding 



The amount of support for educational research and 
development varies from foundation to foundation, 
as does the feasibility of assessing the proportion 
of funds so deployed. The Commonwealth Fund granted 
a total of $7.6 million in 1968, 6.7 million of 
which was devoted to medical education and community 
health. It is not possible to determine from the 
Annual Report the proportion going to educational 
research and development, but the National Board of 
Medical Examiners was given $300,^00 to study edu- 
cational testing and measurement. The Danforth 
Foundation granted a total of $6,984,000 in 1967-68, 
but only $617,000 (or less than 10%) of this pay- 
ment was made on grants approved during that year. 

In addition, $5,973,000 in grants were approved in 
1967-68, but were not paid at that time. In other 
words, only 10-15% of the Foundation's approved 
grants are paid during any one year, evidencing a 
long-range time dimension in grant operation. It 
is impossible to determine specifically the research 
and development grants from this total operation. 

The Foundation's operating program cost $3,780,000 
during the 1967-68 fiscal year. 

The Esso Foundation provided $512,000 in 1967*68 to 
21 different grantees for educational research and 
development, and in the previous year provided 
$424,000 to 30 different grantees. Over the 13-year 
period from 1955 through 1968, the Foundation av- 
eraged $156,000 for eight and a half grants a year. 
These figures indicate that the amount and incidence 
of support in educational research and development 
is increasing. The Foundation granted a total of 
$2,536,000 in 1967-68, an increase of $75,000 over 
the previous year, including $216,700 for SPUR 
projects . 

During FY 1967, the Grant Foundation appropriated 
$2 , 826 , 174, of which $1,222,700 was granted for pro- 
jects on the psychological aspects of education. 

Only $800,800 of the total appropriations were paid 
during the year, and $1,764,800 was spend for appro- 
priations made in previous years. The Foundation, 
therefore, seems to experience an approximate 35-40% 
project turnover each year. The staff indicates 
that approximately $500,000 is granted each year for 
projects that could be classified as educational R&D. 
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During the 1967-68 FY, the Hill Foundation granted 
a total of $2,720,000 out of which some $295,000 
(according to its estimates) might be considered 
research and development. They estimate that their 
educational giving was down about 1/3 from the pre- 
vious year. The Foundation has a close monitoring 
policy, and, therefore, during the' year some $320,000 
in grants were cancelled and some $640,000 was re- 
funded from grants previously made. 

The Lilly Endowment gave an estimated $150,000 (of 
its approximately $2,400,000 in educational grants) 
to research and development. Educational giving is 
said to be less than it was five years ago. A total 
of $5.9 million was granted on all projects during 
the year. 

The Mott Foundation report did not provide lists of 
its expenditures. 

4. Feedback 



All of the foundations that are discussed here re- 
quire their grantees to submit reports on their 
projects. The Commonwealth Fund asks for informal 
progress reports and a final written report. The 
Danforth Foundation does some monitoring and re- 
quires an annual statement from each grantee. The 
Esso Foundation requires only final reports. The 
Grant Foundation requires at least annual reports, 
and some site visits are made. The Hill Foundation 
usually requires semi-annual reports, and always 
asks for annual and final reports. In addition, 
staff members visit and confer with grantees and 
sometimes consult advisory groups for particularly 
uncertain projects, The Lilly Foundation has in- 
formal contacts with its grantees and requires brief 
annual resumes and complete final reports. The Mott 
Foundation is in close contact with its grantees, 
with staff members personally evaluating and moni- 
toring the progress of funded programs. In addition, 
both quarterly and annual reports are required. 

5 . Dissemination 

Typically, as with other foundations s. \died, these 
seven leave dissemination up to the grantee, but do 
some reporting in the Annual Report. The Commonwealth 
Fund usually does not support dissemination directly, 
but does underwrite some monographs that result from 
its projects. The Fund will also occasionally sup- 
port other monographs that have limited, but 
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important, appeal. The Danforth Foundation occa- 
sionally supports major publications in areas in 
which they have concentrated their efforts. Some 
progress reports on projects are included in a 
periodical bulletin sent out by the Foundation. 

The Esso Foundation retains first publishing rights 
on all monographs and reports arising out of pro- 
jects it supports, and also supports a journal 
called "Change" which is devoted to academic crit- 
icism, commentary, and innovative ideas in the field 
of higher education. This journal is not necessarily 
a reporting vehicle for the projects it supports. 

The Grant Foundation describes all projects in its 
Annual Report, and supports some publications in its 
area of interest. The Hill Foundation provides a 
detailed description of the projects it supports in 
its Annual Report and does provide some support for 
publications reporting or originating out of the 
projects that it funds. The Lilly Foundation will 
support dissemination as a part of a project, but 
makes no special efforts otherwise. The Mott Found- 
ation regards its extensive visitation programs to 
the Flint Community Schools as its main dissemination 
tool and, in addition, gives detailed statistics 
on programs and participation in its Annual Report. 
The Mott Foundation also supports various university 
centers and internship programs which hopefully util- 
ize knowledge gained from studies of the Flint 
program. 

6 . Tie-In With Other Foundations and the Federal 
Gove rnment 

All of the foundations discussed here, with the 
exceptions of Esso, mentioned that they consider 
the activities of other foundations and the Federal 
government as they define their cwn program areas. 

The Commonwealth Fund indicated that Federal support 
of activity has provided reason for their own re- 
definition of areas of interest. The Dansforfh 
Foundation indicates that they are increasingly 
sensitive to efforts of other foundations and are 
making efforts to cooperate more closely with them. 
The Hill Foundation indicates they occasionally will 
work with other foundations if they (the Hill found- 
ation) are in at the beginning of the project. The 
Lilly Foundation indicates occasional project 
sharing, but no conscious attempt is made to in- 
crease the level of such activities. 





chapter III 



THE PERFORMERS OF EDUCATIONAL RESEARCH AND DEVELOPMENT 



Three principal groups of "perf ormers Ir of educational R&D 
were included in this study: the universities, the R&D Centers 

sponsored by the Office of Education, and the Regional Educa- 
tional Laboratories , also sponsored by USOE. 

In one sense, this triumvirate is a totally artificial and 
potentially misleading sample of educational R&D performers 
in the United States. Education, like any cultural activity, 
is significantly molded by secular changes in technology and 
philosophy -- changes that may emerge from a wide variety of 
private and public, individual and group, activities. As , 
Bloom, Getzels, Cronbach, Suppes and others have pointed out 1 , 
paradigmatic alterations in education are constantly going on, 
and have roots in the disparate work of academic scribblers 
and systems engineers of some years back. 

Even a survey of contemporary and specifically articulated 
"educational R&D" , would have to go far beyond the institutions 
considered in this present survey. Industrial offshoots such 
as General Learning Corporation and Westinghouse Learning 
Corporation, private testing services like ETS , and a host of 
textbook and educational hardware companies are important 
centers of educational research and development. In terms 
of its broadest definitions, educational R&D is, in fact, so 
vast, so diffused, so thoroughly mixed with "operations" and 
even "architectures" as to make a comprehensive survey next 
to impossible. 

Universities, R&D Centers, and laboratories, then, can be 
considered useful "for instances" of a larger and expanding 
universe . 

In addressing this triumvirate, the technique used was a 
structured interview, conducted by 14 interviewers recruited 
from various regions of the country. The institutions 
covered were selected in consultation with USOE. All inter- 
views were conducted organizationally at a high level, typically 



^Benjamin S. Bloom, "Twenty-five Years of Educational Research", 
A merican Educational Research Journal , Volume 3, Number, May 
1966; J.W. Getzels , n Paradigm and Practice: On the Contribu- 
tions of Research to Education", mimeographed; Lee J. Cronbach 
and Patrick Suppes, Research for Tomorrow^ Schools: Disciplined 
I nquiry for Education , Editors, New Yorks The Macmillan Company, 
1969. 



combined Center and Regional Laboratory program. This did 
not mean the abandonment of the funding of separate projects. 
Far from it. Out of the current USOE/RSD educational budget 
a fairly high percentage goes for project support, perhaps 
as much as 30%. And, most of this goes to universities. 

1. Universities 

Sixteen universities ware chosen for review. These 
16 were identified by multiple respondents as having 
"highly regarded" educational R&D resources.* The 
parts of the selected universities most relevant to 
the work of this survey tended to be schools of 
education and departments of psychology. Altogether, 
these 16 universities received approximately 40% of 
USOE's educational R&D grants during fiscal years 
1965, 1967 and 1968, or a total of about $70 million 
for the three-year period. 

The pattern that emerged from the interviews at the 
universities is one cogently stated by the dean of 
one of the best-known schools of education — "Our 
policy is to hire good people and give them a free 
hand .... The professors set their own guidelines .... 
Staff interests control our research activity." 

Other supporting and illuminating comments included 
the following: " . . . . projects are generated out of 
the heat and light of a f aw people .... With respect 
to internally generated projects, the college pro- 
fessor participating is king." 

"The guidelines for determining areas of interest 
come from the investigators themselves. This is 
consistent with the fact that the school of education 
operates in a manner similar to that of any other 
academic unit within the university." 

"Talents are found in tha faculty, and support is 
sought for those talents as opposed to handing 
guidelines down from the top." 

Lest this sound too much like substantive anarchy in 
the professional ranks, two qualifications are 
necessary: 

a. In practically all cases, proposed research pro- 
jects must be approved by the dean, the depart- 
ment head, and/or (In some cases) by a research 
committee. There can be any number cf reasons 
for this procedure other than an attempt to con- 
trol research content (e.g., controlling research 

*See appendix for list of universities. 




with university deans or department heads, and with directors 
and associate directors of the R&D Centers and the regional 
educational laboratories. 

The findings from the interviews have been placed in the 
context of a rapidly growing body of excellent literature 
about the performers of educational R&D in the United States 
-- especially R&D Centers and educational laboratories. 

The choice of issues established for special consideration in 
this survey was influenced strongly by the results of inter- 
views with the sponsor groups (Chapters I and II) and by the 
Impact and Attitude Surveys (Chapter IV) . 

The principal issues selected were these: 

1. Whether R&D activities are mainly conducted on a 
M project" or on a "program' 1 basis. 

2. The degree to which research is multidisciplinary. 

3. Attitudes towards the delivery of the research 
results to the classroom. 

It may be useful as a preamble to the findings to note the 
following idealized spectrum cf educational "knowledge into 
practice' 1 involving the component institutions in our survey: 



I Pure Research 




Application i 


1 Universities 


R&D Centers 


Educational Laboratories 1 



The fact that some pure research is in fact taking place in 
Educational Laboratories and some direct demonstration, 
development, and diffusion activities are being undertaken 
by lone scholars in universities or by groups in R&D Centers, 
should not blind us to the fact that the spectrum has general 
validity. 

Until 1963 practically all of the. limited USOE funds for 
educational R&D vere allocated on a "project" basis. That is, 
a grant would be approved if a researcher could demonstrate 
the need for the new knowledge which he proposed to develop, 
if he could demonstrate professional qualifications and tech- 
nical competence and i f he had the support of his institution 
(usually a university). Little regard was paid to the rela- 
tionship between individual research projects or to their 
prospective cumulative contribution to the solution of problems. 
The resultant research output, whatever its scientific validity, 
contributed fragments of problem solutions but left many pieces 
of the puzzle missing. 

Largely because of this situation, USOE decided to establish 
its R&D Center program, which was later expanded into the 
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load which might eat into classroom time, avoiding 
duplication, appraising the proposal for technical 
excellence). Nevertheless, approval of projects 
prior to submission to a sponsoring agency does 
create an opportunity to guide proposals into at 
least a loose programmatic format. 

b. Many schools and departments do have specialized 
emphasis in their teaching . This is bound to 
result in a similar emphasis in their research, 
even while professorial independence is being 
maintained. The reason is that faculty members 
tend to be employed because of their professional 
interest in the teaching mission of the school 
(department). For example, if the major purpose 
of a school is to produce qualified elementary 
and secondary teachers, it is likely that re- 
search will be related to elementary and secon- 
dary school problems. 

In spite of these qualifications, it seems abundantly 
clear that the universities are not generally engaged 
in programmatic educational R&D in any meaningful 
sense. This, of course, is in keeping with the tra- 
ditional role of the universities in their research 
capacity -- the role of giving free rein to discrete 
scholars in their search for new knowledge. 

University research tends on the whole, then, to be 
project oriented. It tends not to be multidisci- 
plinary in character. It tends to have no interest 
in the application of research results to general 
classroom use. 

2 . R&D Centers and Regional Educational Laboratories 
With respect to the 9 USOE-funded R&D Centers and 
the IS USOE funded regional laboratories in the 
United States, all are to some extent, programmatic. 
They have to be. However, projects are the pieces 
from which a program is created and maintained, and 
logically there are many different ways in which 
these pieces might be put together. At one extreme 
one might find a group of independent projects 
loosely related tc one another which have been 
brought under a single organizational umbrella, 
and called a "program” . At the other extreme, one 
might define highly specific program objectives 
and admit into the program only those projects rele- 
vant to meeting those objectives, with strict central 
management controls. 




Both extremes are archetypes. Neither is, in fact, 
evident in any pure form from the interview results. 



In general, interviews indicate a continuing refine- 
ment of programmatic goals in both the R&D Centers 
and the laboratories. Much of this refinement has 
taken place as a result of budget stringencies, and 
of USOr staff and site-committee pressures upon 
local research management. The programmatic thrust 
of the several centers and labs, and some of their 
traumas in defining programmatic targets during 
their early years, have been cogently analyzed 
elsewhere.* A general summary of stated programmatic 
emphases can be found in the instructions to inter- 
viewers, Appendix A. 

What must be emphasized here is the fact that a 
shortage of S & E money in the USOE budget has made 
it difficult to the point of virtual impossibility 
to rationalize in any meaningful, interdependent 
sense the over-all programmatic gestalt of institu- 
tionalized educational R&D among the several centers 
and laboratories. Programs were initially developed, 
not in terms of a Washington-created set of inter- 
locking priorities* Programs evolved out of the 
accidents of enthusiasms and talents related to the 
creation and subsequent modifications of the staffs 
of the centers and laboratories. 

Perhaps this is the only way the centers and labs 
could have evolved. But after five years of more 
of operations, the net impression left on the pro- 
grammatic integrity of the total Title IV activity 
involving centers and labs is that is is extremely 
cloudy. Expediential responses to funding crises, 
and the not always consistent comments -- formal 
and informal -- of various site vistors and staff, 
have tightened at least the language describing 
many centers and laboratory programs. Much good, 
highly directed research goes on. But looking at 
the centers and labs together, there is still little 
programmatic strategy in national terms, there are 
large and serious R&D gaps, there is seme duplication 
of effort, and there is considerable confusion over 
mission definition. 



*See, for example, the Journal of Educational Research & 
Development , January 1970, passim . 





Turning to the second issue, the extent to which 
center and laboratory research is, in fact, multi- 
disciplinary, the answer is mixed and it is changing 
over time — especially in response to pressures 
from the United States Bureau of the Budget and its 
scientific allies around Washington. One of the 
fears of the drafters of Title IV of ESEA was that 
traditional educationists and psychologists would 
dominate the educational R&D efforts under an 
expanded Cooperative Research Act largess. The 
concern of Congress to promote a multidisciplinary 
approach to educational R&D is best described in 
the following excerpts from the House Committee 
Report on ESEA (Committee on Education and Labor, 
89th Congress, 1st Session, Report 143, page 18). 

"Title IV authorizes the establishment of 
a series of national and regional educa- 
tional laboratories providing comprehensive 
support of educational research, develop- 
ment, dissemination, and training. Through 
this program artists, historians, mathema- 
ticians, and other scholars would work 
closely with psychologists, sociologists, 
teachers, and administrators from local 
school systems to conduct research, develop 
it into forms that can be used in classrooms, 
continually test and retest these new forms, 
train teachers in their use and make re- 
search results available to local school 
systems . n 

"Involvement of different types of intel- 
lectual talent as well as different types 
of educational concerns will be crucial 
to a broad-based laboratory program. The 
scholar, the researcher, the local school 
teacher, and the administrator would work 
together as a team to develop high-quality 
programs for a wide segment of the student 
population. The laboratory program calls 
for involvement of the educational system 
at many levels -- state departments of 
education, local school systems, colleges 
and universities, the proposed supplemen- 
tary educational centers, and experimental 
schools. In addition, private research 
organizations, industry, and other groups 
in the community with appropriate talent 
and resources have much to contribute to 
the activities of the laboratories." 



’’Such cooperation is relatively new but 
it is already showing promise of becoming 
a successful educational research strategy. 

Recently the National Science Foundation 
and the Office of Education have supported 
projects with interdisciplinary represen- 
tation from universities and school systems. 

Working together, these teams have produced 
new instructional materials and systems, 
laboratory equipment, textbooks, teacher 
guides and films. Pilot research and 
development centers using this approach 
were established under the Cooperative 
Research Act in 1965 at a cost of approxi- 
mately $1.9 million at the Universities 
of Pittsburgh, Oregon and Wisconsin, and 
at Harvard University." 

Practically the same language occurs in the Senate report and 
in floor discussion in both houses. It is not clear whether 
the reference was being made to the R&D Centers, to the 
regional labs, or to both. In context, it appears to apply 
to both. However, it is perfectly clear that the sponsors 
of the ESEA (which included USOE) and the Congress wanted to 
bring a wider spectrum of expertise into the business of 
educational R&D, and that USOE acted shortly after the passage 
of the act to move in that direction. 

In the summer ox 1968, the Journal of E d ucational Researc h 
and Development compiled a table showing the academic disci- 
plTnes of the professional staff members of the various R&D 
Centers around the country. A facsimile of the table appears 
on the following page. 

The data would indicate that except at John Hopkins, there is 
little multidisciplinary collaboration in the R&D Oerters -- 
beyond the traditional linkage between psychologists and 
educationists . It is clear from field interviews and from 
conversations with the USOE staff that the regional labora- 
tories have done little better — at least until recently. 

"Until recently 1, is an important qualification. In the higher 
staff echelons of the Federal government, there is a pervasive 
suspicion of the intellectual competence and rigor of the bulk 
of existing and self-styled educational resear ch-and-develop- 
ment specialists in the United States. Turning to the "science 
fraternity" for advice and guidance, the program and budget 
people responsible for high level staff recommendations to the 
President and his Cabinet on educational matters, have had 
most of their prejudices reinforced by the findings of 
"scientific panels". "Educational R&b is too important to be 
left to educationists and psychologists" is the general 
refrain. Within this view of reality, the only way to make 



O 

ERIC 



57 



(58 



RESEARCH AND DEVELOPMENT CENTERS 





1 

1 Total Personnel | 


o 

<N 


31 


23 


'j 

VO 


25 


»n 

cj 


32 


<n 

H 


VO 

<N 


vO 

VP 

<N 


Not Specified j 


! 

i 


VP 


1 

t 


r-f 


! 




VP 


| 


n 


18 


n 

© 

s 

o 


n 


<N 




VP 


<N 


j 


<N 


i 


iH 


19 


<N 

fe 

0 

H 

0 

•H 

U 

0 

<0 


m 


<N 


H 


r 1 


VO 


i 

i 


<N 


H 


17 


i 

| 33 


Psychology * j 


CM 


10 | 




<N 


tH 


13 


a\ 


r* 


CN 


63 


Education 


12 


H 

r 1 


12 


1 

44 


16 


10 


r> 

iH 


♦ 1 
iH 


m 


132 


CENTER FOR: 


Educational Adm. 
(Oregon) 


Learning R&D 
(Pittsburg) 


Cognitive Learning 
(Wisconsin) 


Educational Stimulation 
(Georgia) 


Teaching 

(Stanford) 


Teacher Education 
(Texas) 


Higher Education 
(Berkely) 


Evaluation in Instruction 
Programs (UCLA) 


Social Organisation of 
Schools (John Hopkins) 


TOTAL 



P 

< 



C 

W 



O 



«J .c 
o o 

•H © 
P © 





p 




a 




H 


9 


© 




K 


0 


H 


.H 


© 


0 


•H 


XZ 


O 


o 


0 


>1 


w 


© 




ft. 


ip 




0 


i-H 




* 


p 



c 

o 

♦H 

P 

« 

u 

p 

*0 

w 



P u 
© © 
■a »o 

§ § 

tn tn 
c c 

•H -H 

p p 
w M 

■H -H 



o 

A V 

.. & 
n O 
P 
* « 

w -j 

■H 

P v 
flj O 

e -H 

© M 

** 
•' xi 
«r a 

rj 

w & 
o o 

1 * 
c * 
O fc> 
O C 
W -H 
M 
0) 
.. o 
~ c 

» H 

© G 
P w 

o •<• 

iH AS 

r 

(N 

. I * 
* C 
p o 

O H 
H P 
w rJ 
P 

m P 

© W 
C -H 
-H C 



j>« 

W 

*rl n 

tJ w 
. « 
© *H 

^53 

M M O CQ 

f I ro 



m 

© 

■8 

H 

l> 

C 



O 

Z 



O 

> 



© 

o 

p 

3 

O 

w 




Compiled from listings in Journal of Research and Development in Education 
(University of Georgia, Athens, 1968) 



the R&D Centers and the labs perform effectively (and satisfy 
the legislative mandates mentioned above) would be to have 
them bring aboard staffs drawn from the most sophisticated 
areas of mathematics, the natural and behavioral sciences, 
and physical and social engineering. 

There is some evidence that this continuous pressure upon 
the USOE staff has been displaced to the centers and labs, 
and that new types of scholars and practitioners are in 
fact now being drawn into the institutionalized educational 
R&D supported by Title IV funds. 

But there is still a long way to go before the centers and 
labs can be considered truly multidisciplinary. 

The only caveat to this rather gloomy conclusion about the 
recent past is that the university setting does permit the 
centers to draw on university faculty members on an ad hoc 
basis without necessarily listing them as members of the 
center’s professional staff. The occasional (and oblique) 
references to "consultants” \.hich came up in the course of 
interviews suggests that this has been the usual practice 
-- at least in some cases. Furthermore, many schools of 
education are sufficiently multidisciplinary within 
themselves to provide the variety of expertise needed for 
broad-based educational research. The formal names of 
academic schools (and the titles of individual staff 
members) are often misleading. 

Nevertheless, it is fair to conclude from the data that the 
establishment of the centers and the labs has done little -- 
at least until recently -- to diminish the dominance of the 
faculties of education and psychology in the field of 
educational R&D. 

The final issue, that of dissemination and diffusion activi- 
ties of the centers and labs is difficult to summarize. 
Perhaps a fair reading is that all do some and a few do much 
but, in total, the "knowledge-into-practice" activities 
leave much to be desired. 

In fairness, there are reasons. First, compared to the cost 
of basic research, development-demonstration-diffusion work 
is exponentially expensive. Second, the number of academics 
who have any "feel” for, or expertness in, this kind of 
activity is critically small. Third, D-D-D specialists tend 
to suffer from status differentials in settings largely 
dominated by academic research specialists. 
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In any case, whatever the claims of R&D Centers and labs 
(and some of them, notably the Wisconsin Center and the 
Philadelphia Lab, have made some remarkable progress along 
this line) , the overall picture is regrettably inadequate. 

As will be seen in the following chapter, the centers and 
labs do not "get there" (or if they do, the school superin- 
tendents do not know about it). 

What is clear is that both the labs and the centers are 
increasingly conscious of their obligations to "deliver" 
research results. A few quotations from interviews vali- 
date this conclusion: 

From a Center : 

Tr Th7j procedure of the Center is to field test, pilot 
test, and demonstrate so that people can see it as 
well as read about it." 

Fr om a Lab : 

^ive site schools geographically distributed serve 
as sounding boards for R&D ideas, initial dissemina- 
tors and schools which provide a relationship with 
other school districts in the region." 

From a Center : 

n Th<T Cente r is strongly committed to moving its 
programs into action phases. The Director compares 
the Center's role to that of the agricultural exten- 
sion service; it would fail in its miision if it 
stopped at research alone. The original program of 
the Center was heavily oriented toward research; 
this has beer, reduced to a nearly 50-50 balance 
between research-development-evaluation and action 
programs . " 

From a Lab : 

"The Lab is very much interested in implementation . 

The second major focus of its work (in addition to 
testing) is diffusion strategy. This involves building 
training packages for teachers; teaching principals; 
building a feedback loop so that one can tell when the 
package is going sour. By doing this, the Director 
aims ultimate]. y toward what he referred to as a "mail 
order diffusion package" which could be used in a 
situation in which the Lab's output could be widely 
implemented throughout the country." 

In the brief time allotted for the survey, it is difficult 
to tell how much of the above is rhetoric. 

One must conclude that the mandate is there, tho will is there; 
the knowledge, instrumentalities, and funds (by and large) are 
not. 
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CHAPTER IV 



THE IMPACT AND ATTITUDE SURVEYS 



A major part of the investigation was to make an assessment 
of the attitude of educators and policy makers towards educa- 
tional research and development, and, the impact of educational 
research and development on educational policies and practices 
at the local level. 

These two tasks absorbed most of the time and effort of the 
project staff. They also provided the only quantifiable 
data — and the most meaningful new material -- produced dur- 
ing the course of the investigation. When they are tied into 
the highlights of the interview results, as given in the pre- 
ceding three chapters, they suggest the direction that should 
be taken in the educational research and development field. 

The data were derived from an Impact Survey and from an Atti- 
tude Survey, each of which, with the results, is described 
below and in Appendices B and C. The data for the Impact 
Survey came from district school superintendents. Respon- 
dents in the Attitude Survey included officials in organiza- 
tions sponsoring educational research and development, people 
engaged in such activity, and (in the case of a few questions) 
the same district school superintendents who were respondents 
in the Impact Survey. 

Very briefly, the conclusions are that the products of educa- 
tional research and development have had very little perceived 
effect on educational policies and practices; that sponsors 
and performers of educational research and development are 
painfully aware of this, and that all three groups — users, 
sponsors, and performers — believe that steps should be taken 
towards more near-time relevar ;y of R&D efforts and towards 
implementation of R&D results in the classroom. 



THE IMPACT SURVEY 

A survey was conducted in late 1968 and early 1969 by the 
Eureau of Social Science Research^ in order to assess the im- 
pact of educational R&D on educational policies and practices 
at the classroom level. (Appendix B describes the method- 
ology in detail.) 



As was stated in the summary, this survey was made under con- 
tract with SURC. SURC take3 full responsibility for the inter- 
pretation of the results. 
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The survey was conducted in two stages: a pre-test personal 

interview survey of superintendents in 55 school districts, 
followed by a mail questionnaire which was returned by 60% 
of the 574 district school superintendents to whom it was 
sent. 

The results of returned questionnaires were used (with appro- 
priate statistical procedures as described in Appendix B) as 
a sample of the 9,000 -- odd school districts with enrollments 
of 600 to 100,000 pupils, with a total student population of 
33.8 million. In spite of the samll size of the sample and 
the relatively poor response rate, it is considered that the 
results are valid if they are taken to be measures of general 
ma gnitude . For example, when the data show that a certain 
Innovation (Non-Graded Sequencing) has been adopted by 22.5 
percent of the nation's school districts, the reader who in- 
terprets this to mean "about a fourth" will not be far wrong. 

Added to this qualification is the fact that the sample did 
not include the approximately 10,000 very small school dis- 
tricts with an enrollment of less than 600 or the 26 districts 
with enrollment of 100,000 or more. Accordingly, when re- 
sults are generalized to the entire American elementary and 
secondary school system, some liberty with the figures is 
being taken. 

Data were broken down into six categories of district size 
(enrollment) and were then blown up, by the method explained 
in Appendix B, to represent a national projection of the 
chara* teristics of the roughly 9,000 districts represented 
by the sample. The size groupings was as follows: 

Student Enrollment Number of Districts Estimated Student 

(in thousands) in the U.S. Population (in Millions) 



25-100 


149 


5.7 


12-25 


373 


5.7 


6-12 


891 


7.1 


3-6 


1670 


6. 7 


1. 2-3.0 


3519 


6.5 


0.6-2. 0 


2486 


2.1 


TOTAL 


9088 


33.8 



As might be expected, the smaller school districts displayed 
less inv.erest in educational research and development than 
did the larger ones. This is general phenomenon, with some- 
times a very wide range between the smaller and the larger 
districts. The range, and its generally linear progression 
from small to large, is shown in detail in the tables in 
Appendix B. For the most part, the tables in this chapter 
list only the statistical data (projected from the sample to 
national averages) for the smallest and the largest districts. 
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The first set of questions put to the superintendents 
had to do with the extent to which they had introduced 
into their schools many generally accepted innovations 



1. Initially, the Superintendents were asked whether 
their districts had adopted any of a list of 17 
"new" teaching or staffing practices, and, if so, 
the extent to which they were in use in the districts. 
The response to this question is startling. The 
data below shows the percentage of school districts 
which have made no use of the named practices, and 
the minimum number of students without access to 
them. Many of these 11 innovations " have been ac- 
cepted as desirable practice for a number of years, 
yet only three of them -- teacher aids, ability 
grouping, and elementary departmentalization — are 
used to any extent in more than half of the districts 
represented by the sample. If data had been gathered 
with respect to individual schools, rather than with 
respect to school districts, the nonuse figures 
would clearly have been higher. It is safe to as- 
sume that relatively few districts which reported 
use of a stated practice have put it into effect in 
all of the district's schools. Furthermore, as will 
be seen from the fuller presentation of the data in 
Appendix B (tables 1, la and lb) a significant pro- 
portion of the districts which reported a practice 
as having been adopted also reported that its use 
was ‘'limited" (defined as being used by less than 
50% of the schools at any grade level). Thus, the 
figures are a clear understatement of the failure of 
district shcool systems to adopt the listed practices. 
The same is true of the figures relating to students 
without access to the practice. There are, of course, 
many reasons other than inertia or simple resistance 
to change which might account for the failure in any 
given school district to adopt some or any of the 
listed practices. Some of them are costly, either in 
terms of personnel or equipment, or both. Come re- 
quire teaching skills which might not be available. 
Some might positively be harmful in a given situa- 
tion. Nevertheless, the fact remains that most of 
the listed practices are taken for granted as being 
desirable in a normal situation, as representing 
advances in educational techniques, and as being 
something that school systems "ought" to adopt. It 
is difficult to escape the conclusion that inertia 
and resistance to change are among the major reasons 
for the low level of adoption. Whatever the reasons, 
the data add to the evidence that the American 
school system responds to change in a very sluggish 
manner . 
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Table IV-1 

Percentage of Districts Reporting No Use 
of Selected "New" Practices 



Practice 


All 

Districts 


Smallest 

Districts 


Largest 

Districts 


Minimum 
Number of 
Students 
without access 
to practices 
(millions) 


Teacher Aides 


30.7 


27.1 


26.7 


9.0 


Ability Groupings 


37.7 


45.8 


35.6 


11.6 


Elementary 

Departmentalization 


42.0 


39.6 


33.3 


a 


Team Teaching 


62.4 


72.9 


33.3 


16.8 


Elementary Resource 
Teachers 


67.7 


79.2 


33.3 


a 


T . V . Instruction 


€2.6 


64.6 


37.8 


17.9 


Movable Partitions 


69.0 


85.4 


46.7 


18.7 


Non-Grad 'I Sequencing 


77.5 


87.5 


33.3 


20.4 


Independent Study 


70.1 


85.4 


57.8 


20.6 


Programmed instruction 


74.5 


77.1 


62.2 


22.7 


Individually Prescribed 
Instruction 


74.1 


75.0 


72.2 


23.3 


Elimination of Letter 
Grades 


75.3 


65.4 


67.7 


23.3 


Gaming 


82 3 


95.8 


71.1 


25.6 


Modular Scheduling 


87.8 


91.7 


64.4 


26.5 


Variable Course Length 


87.0 


97.9 


73.6 


27.1 


Middle School 


85.5 


89.6 


82.2 


a 


Extended School Year 


94.7 


93.8 


91.1 


31.7 



a - No estimate possible; practice is grade-level specific. 
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2. Whereas the previous question dealt with new teaching 
and staffing innovations, the next one had to do with 
cirriculum changes. In this question, the superin- 
tendents were first asked whether their districts, 
since 1965, had adopted and used extensively any new 
sets of curriculm materials in each of nine subject 
areas. The results are summarized in Table IV-2. 

As was the case above, the data are given in negative 
form to show the percentage of districts which re- 
ported no curriculum chang e. 



Table IV-2 

Percentage of District Reporting No Curriculum Change 
In Selected Subject Areas Since 1965 



Subject Area 


All 

Districts 


Smallest 

Districts 


Largest 

Districts 


Minimum 
Number of 
Students 
without access 
to subject changes 
(mi llions) 


Scier.ce 


51.0 


81.2 


35.6 


15.7 


Mathematics 


56.5 


64.5 


44.5 


17.7 


Reading 


60.2 


64.5 


44.5 


17.7 


English 


71.5 


83.3 


40.0 


20.5 


Social Studies 


76.8 


91.6 


60.0 


21.9 


Foreign Language 


80.4 


83.3 


60.0 


23.7 


Special Education 


83.8 


89.5 


77. B 


27.1 


Language Arts 


88.1 


87.5 


75.6 


27.4 


Fine Arts 


91.5 


93.7 


88.9 


30. 8 



Between 50 and 60% of the districts showed no such 
changes in the subject areas of science, mathematics, 
and reading. From there on, the percentages rise 
rapidly, to about 70% in English, over 75% in social 
sciences, around 80% in foreign languages and special 
education, and in the neighborhood of 90% in language 
arts and fine arts. It should be emphasized once 
again that these are minimum figures when they are 
translated into numbers of schools or students ef- 
fected. It is clear that in all subject areas, the 
curriculum materials offered to the majority of stu- 
dents have not been changed since 1965. 
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Hovrever, a more cheerful perspective may be obtained 
by looking at the data from the positive side. After 
all, there have been curriculum changes in 40% or 
more of the districts in science, mathematics, and 
reading, in about one-quarter of them in English, 
and so on. Furthermore, the innovation record of 
the largest districts is very much better than that 
of the smallest ones except, perhaps, in the case 
of fine arts. Over half of the largest districts 
have changed their curricula in the major problem 
areas; science (65%), mathematics (55%), reading 
(55%) and English (60%) . In social studies and for- 
eign languages, 40% of the largest districts have 
introduced new course materials. These are the 
principal problem areas. And, in all of these areas, 
a greater percentage of the second largest group of 
districts (12-/ to 25-thousand students) showed 
curriculum changes.! 

One can look at the results either with pessimism 
or optimism. On the one hand, updated curriculum 
materials are available at reasonable cost, and the 
need for them has bean advertised widely by educators. 
Yet their rate of adoption has not been very high, 
especially among the smaller districts. On the 
other hand, the time has been relatively short; the 
use of updated materials in many cases requires up- 
dated teaching skills, and the larger districts ap- 
pear to be moving ahead. The optimistic view is 
reinforced by other evidence on interest in cur- 
riculum change, as shown by the response to questions 
discussed below. 

In appraising these figures, it should be borne in 
mind that the respondents were asked to report adop- 
tion of new curricula since 1965. It is possible 
that in a number of districts new curricula were 
introdv^d pi ior to 1965, and were not reported. 

This would le<d to an understatement of the current 
use of modern course materials. However, the di- 
rection, if not necessarily the magnitude, of this 
qualification is offset by the fact that when they 
are statud positively (adoption) the figures lead to 
an overstatement of the number of schools and students 
affected. Similarly, when they are stated negatively 
(nonadoption) they lead to an understatement. 
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^The data for all size groups will be fou^d in Appendix B, 
Table 3. 



The question from which the above data were drawn 
also asked (of those who reported changes in curric- 
ulum) the name or type of the programs adopted* The 
responses were then grouped according to broad cate- 
gories of programs. The results are shown in 
Table IV- 3. 



Table IV- 3 

Percentage of District Reporting Curriculum Change 
Since 1965, by Type of Program 



Subject 

Area 


% of all 
Districts 
Reporting 
Change 


Principal Type of Program Reported 

National Regional New New 

Programs Programs Materials Approach 


New 

Courses 


Science 


49.0 


19.9 


4.0 


4.6 


4.5 


7.9 


Mathematics 


43.5 


7.0 


0.8 


7. 3 


27.6 


3.5 


Reading 


39.8 


2.6 


1.0 


18.6 


11.7 


7.5 


English 


28.5 


7.1 


1.6 


2.9 


12.8 


4.6 


Social Studies 


23.2 


1.5 


4.0 


5.8 


6.3 


9.3 


Foreign Language 


19.6 


1.2 


- 


3.0 


9.5 


6.1 


Special Education 


16.2 


0.5 


0.8 


0.1 


4.2 


10.4 


Language Arts 


11.9 


0.6 


0.6 


2.6 


5.3 


2.0 


Fine Arts 


8.5 


- 


0.1 


0.4 


1.1 


6.3 



Note: Includes only programs mentioned by 101 or more of the respondents. 

Some respondents mentioned more them one type of program. 



The superficial conclusion is that the so-called 
national programs are not very well received. This, 
at first sight, appears to be true in all subject 
areas with the single exception of science -- where 
the national programs (presumably, in most cases, 
those developed under the sponsorship of the National 
Science Foundation) share about equal popularity 
with other types of programs. In the remaining sub- 
ject areas, the preference it clearly for programs 
which fall into the three rather amorphous categories 
of new materials, new approach, and new course*. 
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This should not be taken as conclusive evidence that 
the national programs are being largely ignored by 
their target groups. Although there is no evidence 
from the BSSR survey on this point, the interviews 
and literature suggest that national programs have 
been very influential in two respects* First, their 
very existence has pointed up the need for new ma- 
terial, new approaches, and new courses* And, sec- 
ond, the concepts and teaching methods developed in 
some of the national programs have, without any doubt 
been incorporated into new curriculum programs v;hich 
would not be classified as "national" ones* This is 
especially true in the subject areas of science and 
mathematics. It has been suggested by some that the 
apparently low acceptance of national programs re- 
flects the reluctance of people who make local school 
curriculum decisions to accept "packages" in toto, 
no matter what their origins. That is, they want to 
adapt the "packages" to fit, local conditions, to be 
more in keeping with their own pedagogical experience 
to incorporate the best features of several "pack- 
ages", etc. Many of the national programs are al- 
ready designed so that modification and adaptation 
are relatively easy. 

Finally, under this general heading of innovation, 
the superintendents were asked to report innovations 
other than those specifically listed (as shown in 
the preceding tables) which th9y had instituted since 
1965 . In this case, the respondents could list 
changes in teaching or staffing practices, as well 
as changes in curriculum. The results are as follows 

Forty percent of the districts reported such "other" 
innovations* Again, the largest districts were sub- 
stantially more innovative than the smallest ones. 
However, in both size groups, the degree of innova- 
tion was not very high in the specific categories 
mentioned when compared with the degree of innovation 
in the categories listed earlier. Nevertheless, it 
is interesting to note that the innovations most 
frequently mentioned had to do with curricula -- 
expansion of nonbasic courses and vocational educa- 
tion — rather than with teaching and staffing prac- 
tices. The fact that another curriculum related 
item, preschool, is at the bottom of the list should 
be discounted: The responses referred largely to 

Head Start, and do not reflect the very large pro- 
portion of Head Start programs that were instituted 
under other than public school auspices. 



Table IV- 4 



Percentage of District Reporting "Other 11 Innovations 
Adopted Since 1965 



Type of 
Innovation 


All 

Districts 


Smallest 

Districts 


Largest 

Districts 


Vocational Education 
Curricula 


11. 1 


8. 3 


17.8 


Expansion of Non-Basic 
Courses 


11. 7 


12.5 


22.2 


Technology 


9.0 


4.2 


17. 8 


Guidance 


7.6 


6. 3 


13.3 


Pre-School 


7.2 


8. 3 


11.0 


Organization of 
Instruction 


9.8 


2.1 


13. 3 


No '‘Other" Changes 


61.2 


68.8 


42.2 



Note: Innovations were included only if they were mentioned by 

10% or more of the respondents. Some respondents men- 
tioned more than one. 



The next set of questions had to do specifically with 
educational research and development: where the districts 

obtain their information, and whether tuo information 
gets to them in optimum content and form. 

1. To begin at the local level: The superintendents 

were asked whether their current budgets provided 
funds for educational research and development, and 
to describe the research and development activities 
in which their districts were currently engaged. 

In Table IV-5 the results are shown for all district 
size groups because of (a) the nearly consistent 
linear relationship between district size, the per- 
centage of districts in the size group engaging in 
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local research and development activities, and the 
amount of funds budgeted for the purpose, and (b), 
the very wide spread between the smaller and the 
larger districts. Roughly two-thirds or more of 
the districts with over 3,000 students reported some 
local research and development activity. Two-thirds 
or more of the smaller districts reported none. 



Table IV* 5 

Research Activity At The Distr .ct Level, By District Size 



District Size 
(in thousands) 


% of Districts Mentioning Research 
Activities 


Kedi&n Dollar 
Figure for 
R&D a 


Curriculum 

Development 


Testing 

and 

Evaluation 


Organization 

of 

Instruction 


None 


25 - 100 


40.0 


20.0 


*-• 

CO 


22.2 


$63,800 


12 - 25 


37.0 


13.0 


15.2 


32.6 


25„250 


6-12 


37.9 


3.0 


18.2 


3 J . 4 


39,250 


3 - 6 


34.4 


6.3 


17.2 


35.9 


13,350 


1.2 - 3 


13.7 


5.5 


9.6 


65.6 


3,900 


0.6 - 1.2 


8.3 


4.2 


- 


77.1 


1,550 


All Districts 


19.8 


5.6 


9.6 


58.7 


6,300 



Notu: Includes only research activities mentioned by 101 or more of the 

respondents. Some respondents mentioned more than one category. 
d Based on the 141 districts giving a total budget figure. 



Although the median local expenditure by even the 
largest districts can hardly be considered princely, 
the median expenditure by the two smaller sized 
groups is so small as to make one wonder whether it 
is effective at all. However, there is a factor 
here that might suggest a downward bias in. the ex- 
penditure figures if they are taken to be a measure 
of the amount of effort which is, in fact, put into 
educational R&D by the districts. This is that the 
question was purposely put in terms of actually bud- 
geted funds in order to discover how well research 
and development funds survive the annual budget 
scrutiny. Obviously, they do not survive very well. 
However, it is quite possible that activities which 
could qualify as research and development -- especially 



0 




experimentation with new teaching, staffing, and 
organizational techniques — take place without 
specific budget allotments for the purpose. The 
data can not show this. 

Of the three broad kinds of research activity men- 
tioned, curriculum development is by far the most 
widespread in all size groups. This is yet another 
indication of concern with modernizing curricula, 
at least among the innovation-minded districts. It 
also reinforces a point made above, namely, that 
there is a tendency to adapt ‘'packaged" curricula 
to local needs or tastes. At anywhere near the re- 
ported median level of expenditure on all types of 
research and development, it could hardly be ex- 
pected that the local districts would be develop- 
ing entirely new and original curricula. It is more 
likely that their curriculum development efforts are 
in the direction of adaptation and modification. 

2. The next question to be considered has to do with 
the sources of research and development information 
which are most heavily relied on by the superinten- 
dents and their staffs. The superintendents were 
given a list of seven sources and were asked whether 
they (or their staff) used each of the sources with 
respect to educational research and development in- 
. formation (a) to some extent; (b) to a great extent, 
or not at all. Here again the data are shown (in 
Table IV-6) for all size groups because of some very 
interesting characteristics. (Note that the figures 
in the block showing "some use" are inclusive of 
the figures in the block showing "extensive use", 
i.e., they cover any use at all, extensive or not). 

The most impressive conclusion to be gathered from 
this table is that local administr*. * and educators 
dp try to keep abreast of research development 
activities. All of the respondents checked at least 
occasional use of two or more sources. Many of them 
checked all seven. It is clear that, by and large, 
the district school personnel are aware of sources 
of information about educational research and de- 
velopment. It is equally clear that they prefer 
(or know more about) the traditional sources: NEA 

publications, other professional journals, profes- 
sional meetings, and workshops. The preference for 
these traditional sources is high in all size groups, 
and varies almost imperceptibly among size groups. 
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Use of Selected Sources of R&D Information, By District Size 





Note: The figures in the bio.'* shoving "some use" include the figures showing "extensive 



However, when exten sive use of the traditional 
sources is considered, a marked preference for 
meetings and workshops, as opposed to NEA publica- 
tions and other journals is found. The respondents 
do not like tc read as much as they like to talk and 
discuss. Also, there is a familiar progression from 
the smaller districts to the larger ones. Personnel 
in the larger districts attend more meetings, partici 
pate in more workshops and read more in the Journals 
than do the educators from the smaller districts. 

As sources of information, the AERA publications and 
the output of the ERIC system are significantly less 
popular (or less known) than the traditional ones, 
with the reports and other publications from the 
regional laboratories falling somewhere in between. 
Nevertheless, some use, and hence awareness, of 
these sources is fairly high among the larger dis- 
tricts, With respect to AERA and ERIC, the percen- 
tages fall rapidly as the district size becomes 
smaller , 

It should be expected that these three sources should 
be used at the district level on a smaller scale than 
the more traditional ones. The AERA publications are 
by and large, somewhat esoteric, with an appeal more 
to the research community than to the practitioners. 
The ERIC system is new, cind forbiddingly cumbersome 
to the uninitiated. And the regional laboratories, 
besides being new institutions, are specialized. 
Nevertheless, the very small percentage of districts 
which report extensive use of them is surprising. 

The final set of questions elicited opinions about educa- 
tional research and development. 

1. Over half the districts suggested ways in which the 
results of educational research and developi ent ac- 
tivity could be made more useful (Table IV-7) . By 
far the most frequently mentioned was wider dissem-’ 
ination of research and development results. How- 
ever, taken as a whole, the six general categories 
of suggestions add up to one. It is not only wider 
lissemination that is wanted, but better dissemina- 
tion, which includes more workshops and seminars; 
reports that are more readable and better screened 
prior to dissemination, and more demonstration pro- 
jects -- all aimed towards implementation. 
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Table IV- 7 



Suggestions for Increasing Usefulness of R&D Results 
(Percentage Of Districts Mentioning Each Item) 



Suggestion 


All Districts 


Smallest 

Districts 


Largest 

Districts 


Wider Dissemination 


22.0 


22.9 


33.3 


Emphasis On Implementation 


12.7 


6.3 


22.2 


Workshopp r Seminars 


11.3 


6.3 


22.2 


More Readable Reports 


8.6 


8.3 


22.2 


Batter Screening of Reports 


5.1 


- 


4.4 


Demonstration Projects 


5.1 


- 


4.4 


No Suggestions Made 


47.5 


5 8.3 


28.9 



Note: Suggestions are included only if mentioned by 10% or more of the 

respondents. Some respondents made more than one suggestion. 



It should be noted that the superintendents did not 
mention (in sufficient numbers for tabulation) such 
criteria as scholarly excellence, validation of re- 
sults prior to implementation, or even relevance. 
Perhaps they consider these qualities to be present 
automatically . 

2. Table IV-8 shows the disappointing results obtained 
when the superintendents were asked to identify pro- 
ducts of recent and ongoing research and development 
that had, or will have, widespread influence on school 
practices. Only 351 of the respondents names any 
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Table IV- 8 



Major Areas of Ongoing R&D Considered Important 
(Percentage of Districts Mentioning Each Area) 



Area Of RSD 


All Districts 


Smallest 

Districts 


Largest 

Distviccs 


Educational Technology 


15.2 


10.4 


31.1 


Organization of Instruction 


13.8 


6.3 


20.0 


New Basic Curricula 


9.9 


8.3 


20.0 


Staff Utilization 


6.0 


0.0 


20.0 


Learning Process 


4.3 


2.1 


15.6 


None Mentioned 


64.0 


77.1 


28.8 



Note: Areas of R&D were included only if they were mentioned by 10% 

or more of the respondents. Some respondents mentioned more 
than one. 



such products and, in most cases, they were mentioned 
in very genera] terms Among the largest districts 
the response was considerably better than the aver- 
age, but for all other size groups the response rate 
was much lower than might be expected from well- 
informed educators, 

3, If the superintendents found difficulty in pin- 
pointing the contribution of recent and ongoing re- 
search, they were more articulate when it came to 
expressing what they want, The final question in 
this set asked for a listing of the kinds of research 



A The raw data (not tabulated) indicate that less than 15% of 
the respondents mentioned products of specific research pro- 
grams, and these ranged from the generality of "Curricula 
developed by the National Science Foundation" to the particu- 
lar of "Individually Prescribed Instruction researched at 
Pittsburg" . 
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and development which would be most helpful in meet- 
ing district needs. Positive responses were received 
from over 60 % of the districts (and 80 % of the 
largest ones). The desire for new curriculum mi- 
terial is very marked. If the categories of general 
curriculum, specific curricula and individualized in- 
struction are combined, nearly a third of the sug- 
gestions for research help are in the curriculum 
area. The need for research leading to more effec- 
tive teaching ranks even higher. 



Major Areas In 
(Percentage Of 


Table IV-9 

Which Additional R&D 
Districts Mentioning 


Is Needed 
Each Area) 




Area Of R&D 


All Districts 


Smallest 

Districts 


Largee o 
Dis tr j i3ts 


Organization of Instruction 


16.4 


8. 3 


17. t 


General Curricultun 


13. 8 


6.3 


11.1 


Role of Teacher 


11.9 


2.1 


22.2 


Learning Process 


12.4 


10. 4 


31.1 


Needs of Special Groups 


10.6 


6.3 


26.7 


Educational Technology 


7.3 


4.2 


6.7 


Specific Curricula 


7.2 


8.3 


11.1 


Individualized Instruction 


7.2 


4.2 


11.1 


None Mentioned 


42.8 


56.3 


20. 0 



Note: Areas of R&D were included only if they were mentioned by 10% 

or more of the respondents. Some respondents mentioned lore 
than one. 
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THE ATTITUDE SURVEY 



The methodology of the Attitude Survey , its limitation, and 
the full statistical results will be found in Appendix C. 

This survey was conducted in conjunction with the personal 
interviews underlying the material in the previous three 
chapters. A questionnaire was given to each of the inter- 
viewees, asking them to respond to a serie 3 of 35 proposi- 
tions about various aspects of educational research and de- 
velopment, indicating on a scale of 1 to 6 the intensity of 
their agreement or disagreement with the propositions. The 
intensity of agreement or disagreement of each group of re- 
spondents to each proposition was then expressed as a 
weighted score, as is explained more fully in Appendix C. 

The weighted scores (which are given in footnotes in the fol- 
lowing pages) can be read roughly as follows: 



Altogether there were 75 respondents divided into three groups 
in accordance with primary affiliation as follows: univer- 

sities (31); research and development centers and regional 
educational laboratories (26); and government agencies and 
foundations (18). In what follows, these groups will be re- 
ferred to simply as universities, centers, and sponsors. Ten 
of the 35 propositions were also put to 342 District School 
Superintendents in connection with the Impact Survey. 

The most interesting findings are summarized below. It should 
be noted that the propositions were not put to the respondents 
in the order given below, nor ip the order shown in Appendix C. 
Rather, the propositions ir* the original questionnaire were 
arranged randomly so that the connection between related ques- 
tions would not be evident to the respondents. 

The responses, as a whole, show an overwhelming approval of 
educational R&D as being a positive contribution to progress 
in the field of education. In fact, the response to one 
proposition -- that continuing R&D is crucial to the progress 
of American Education 1 -- was so overwhelmingly positive as 
to show that it need not have been put to such a selected 



■^Appendix C, Question El. The weighted scores were: Univer- 

sities plus 86; Centers plus 95; Sponsors plus 84. 



Plus 3 to minus 3: 
Plus 4 to plus 25: 
Minus 4 to minus 25: 
Plus 26 to plus 50: 
Minus 26 to minus 50: 
Above plus 50: 

Below minus 50: 



Neutral 

Agreement 

Disagreement 

Strong agreement 

Strong disagreement 

Very strong agreement 

Very strong disagreement 
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population of respondents. Only two percent of the respon- 
dents registered any degree of disagreement, and 78% checked 
agreement on the highest point of the scale. A similarly 
enthusiastic endorsement of educational R&D is shown by the 
rejection of the proposition that, from the researcher's . 
present levels of R&D funding are adequate. i Only seven 
percent of the respondents agreed; 54% disagreed at the high- 
est point on the scale, and 31% disagreed at the next highest. 

This is not a surprising result. All of the respondents were 
connected in one way or another with educational R&D. In 
most cases, such activity was their most important profes- 
sional work. This group of respondents could not be expected 
to display a negative attitude. 

However, they freely expressed reservations as to whether or 
not educational R&D effort was approaching its potential as 
well as it should, especially in terms of getting the R&D re- 
sults put into practice. 

The respondents were clearly concerned about moving R&D re- 
sults from the laboratory into the schools, but they (espe- 
cially the sponsors) were doubtful about the capacity of the 
current R&D structure to do the job adequately. 



1. All three groups — universities, centers, and spon- 
sors, expressed very strong agreement with the prop- 
osition that effect i ve implementation of R&D output 
is a pressing need « ^ Indeed, the intensity of agree- 
ment was almost as high as that on the proposition, 
cited above (that continuing R&D is crucial to the 
progress of American education) , and was comparable 
to the intensity of disagreement oh the proposition 
about the adequacy of R&D funds. And, in this case, 
there is no reason to suspect occupational bias. 



2. There was less, but still impressive agreement by 

all groups on the related proposition that dissemin- 
ation is the most overlo o ked aspect of R&D. 3 Spon- 
sors were more emphatic in their agreement than the 
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^Appendix C, Question Cl. The weighted scores were: Univer- 

sities minus 68; Centers minus 71; Sponsors minus 74, 



2 

Appendix C, Question D2 . The weighted scores vere: Univer- 

sities plus 71; Centers plus 79; Sponsors plus 76. 



Appendix C, Question D3. The weighted scores were: Univer- 

sities plus 29; Centers plus 30; Sponsors plus 50? Superin- 
tendents plus 50. 
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universities and the centers. This was one of the 
10 questions put to superintendents? they were lined 
up with the sponsors. In this connection, there was 
evidently some confusion as to the precise meaning 
of "dissemination"? evidently the superintendents 
took it to mean something like "get the word out in 
such form that we can use it". The Impact Survey 
supports this interpretation. 

3. There was also agreement by all groups on the prop- 
osition that R&D should be re-tooled so as to be more 
responsive to t he needs of the ultimate consumers 

of R&D outputT^ The intensify of agreement by the 
sponsor’s was "very much stronger. At this point, it 
should be noted that throughout the responses a con- 
siderable more critical attitude towards R&D is dis- 
played by the sponsors than by the other groups, a 
ohenomenon which will be discussed further at a 
later point. 

4. Another consensus — this one being negative -- 
appeared on the proposition that the primary focus 
of R&D shoul d be on theoretical work rather than on 
application . 2 The disagreement was very strong, 
with somewhat less intensity of disagreement being 
shown by the universities than by the other groups. 

As a matter of fact, the intensity of expression of 
this question for all respondents taken f.s a whole 
was the fourth highest among all of the 35 questions. 
It might be argued that, in the minds of some re- 
spondents, the proposition called for a choice be- 
tween basic and applied research, while others thought 
of "application" as meaning something close to "im- 
plementation", This possibility is not important: 
there is a clear preference for activity which goes 
along the road to the classroom. 

With respect to the above four propositions, all groups re- 
sponded in the same direction and with roughly comparable 
degrees of intensity. On the following additional proposi- 
tions, the views of the universities and centers were some- 
what divergent from those of the sponsors. 



^Appendix C, Question C5. The weighted scores were: Univer- 

sities plus 20; Centers plus 26? Sponsors plus 53. 

^Appendix C, Question D7. The weighted scores were: Univer- 

sities minus 44? Centers minus 77; Sponsors minus 60? Super- 
intendents minus 67. 
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5. The Universities and the Centers were in mild dis- 
agreement with the preposition that ie would be aif- 
ficult to justif y the R&D network in terms of actual 
i mpact on the educational system. ^ The sponsors 
were in very strong agreement with the proposition, 
showing a remarkable diversity of opinion from that 
of the universities and the centers. The superin- 
tendents were in mild agreement with the sponsors. 
Their response to this proposition is in contrast 

to the results of the Impact Survey. 

6. Putting the same proposition in a slightly different 

way : that R&D out pu t significantly influences, 

American education , 2 the universities and the centers 
were consistent with their response to the previous 
proposition. They agreed, midly, as did the super- 
intendents. The sponsors again took issue with the 
others, registering relatively strong disagreement. 

The intensity of disagreement with the proposition 

is not nearly as important as the fact that such 
disagreement exists. 

7. On the other hand, the universities and sponsors 
strongly disagreed with the proposition that the 
m ajority of significant educational innovations c an 
55 directly linked to specific R&D undertakings. ^ 

The centers and the superintendents were neutral on 
this point. The apparent contradiction to agreement 
(except by the sponsors) that R&D significantly in- 
fluences American education can probably be explained 
by the words "majority", "directly", and "specific". 

It is generally accepted that most innovations have 
indirect linkages to nonspecific origins, and that 
many of the origins are unrelated to research in the 
usual sense. Thus, one can agree with the first prop- 
osition and reject the second, or reject both of 

them for different reasons. 



Appendix C, Question d 6. The weighted scores were: Univer- 

sities minus 13; Centers minus 17; Sponsors plus 58; Super- 
intendents plus 11. 

2 

Appendix C, Question Dl. The weighted scores were: Univer- 

sities plus 13; Centers plus 19; Sponsors minus 24; Super- 
intendents plus 14. 

3 

Appendix C, Question 08. The weighted scores were: Univer- 

sities minus 37: Centers minus 1; Sponsors* minus 41; Super- 
intendents minus 1. 
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The next proposition to be noted here is that the 
recent proliferation of R&D activities is in response 
to a felt need and is serv ing that need in a more 
than satisfactory fashion. ! The universities agreed, 
strongly. The centers went along with the univer- 
sities, but with less enthusiasm. However, the spon- 
sors disagreed. This hints at sponsor frustration. 

9. And finally, in this set, there is the proposition 

that a sweeping renovation of R&D is overdue. 2 Here, 
the universities and centers were in very mild dis- 
agreement — verging on neutrality. So also were 
the superintendents, but slightly on the positive 
side. The sponsors once more showed consistency 
with their position on other propositions. Their 
agreement with the proposition was strong. The re- 
sults here are in the same general direction but 
with a lesser degree of intensity as the results to 
the proposition cited above in Item 4 that retooling 
is required in order to meet the needs of ultimate 
consumers of R&D. 

From the above, it is fair to conclude that the respondent 
groups are dissatisfied with the present organization and ef- 
fectiveness of educational R&D. Where do they think the weak*' 
nesses lie (except for their nearly unanimous opinion that 
funds are inadequate)? To some extent, they point to the 
researchers : 

1 . "Most researchers are more interested in refining 
their research than in seeinq~ro jec t Results fur- 
ther on the road to implementation . ” 3 Everyone 
agrees, the centers more stronly than the univer- 
sities, and the sponsors more strongly than both. 

The superintendents (who are hardly in a position 
to make a sound judgment on this point) also agrae 
strongly. The implications here are not entirely 
clear. Perhaps some of the respondents, although 
favoring some means cf getting project results 
further on the road to implementation, believe that 
this is not the reseai'cher 1 s job. The interview 



^Appendix C, Question E2. The v;eighted scores were: Univer- 

sities plus 33; Centers plus 20; Sponsors minus 20. 

2 

Appendix C, Question E7. The weighted scores were: Univer- 

sities minus 6; Centers minus 4; Sponsors plus 42. 

o 

^Appendix C, Question D4 . The weighted scores were: Univer- 

sities plus 15; Centers plus 41; Sponsors plus 50; Super- 
intendents plus 44. 
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results reported in earlier chapters bear out this 
possibility. Nevertheless, there is an aura of fault 
finding with the researchers. 



In some cases if blame has to be assessed, it probably should 
be shared by the researchers and the sponsors. 



2 . Does the structure of R&D crea t e a pseudo-researcher 
whose talent is qrantsmanship? ! The universities 
agree, but only mildly, the centers disagree very 
mildly, but the Sponsors agree strongly. 



3 . All three groups agree that R&D efforts are too 
m uch directed to problems of today and yesterday , 
instead of to f o reseeable problems of five or 10 
years from now. 2 The agreement by universities, 
centers and superintendents is not strong, but 
agreement by the sponsors borders on very strong. 
This is a considerable criticism. Certainly the 
researchers are wasting their time (so far as im- 
pact on education is concerned) if they do not look 
ahead to foreseeable needs, and the sponsors are 
supporting potentially useless activity. Note that 
the proposition does not rule out consideration of 
today* s problems if it can be foreseen that much 
the same problems will exist in the future if some- 
thing is not done about them. It simply rules out 
an uncritical projection of t’. e present into the 
future . 



In a larger number of cases, the blame can be laid more 
squarely on the sponsoring agencies who, after all, have 
some responsibility for the effects produced by their manage- 
ment procedures and decisions affecting the allocation of 
resources. Attention is drawn again to the fact that the 
sponsors are generally more critical than the other groups. 

4. A ll g roups agree that in general R&D resources are 
channeled to an elite few. ^ The sponsors agreeing 
slightly (but not significantly) more than the others 



^Appendix C, Question B4 . The weighted scores were: Univer- 

sities plus 14; Centers minus 6; Sponsors plus 46, 

2 Appandix C, Question E8. The weighted scores were: Univer- 

sities plus 17; Centers plus 17; Sponsors plus 45; Super- 
intendents plus 11. 

■^Appendix C, Question A2. The weighted scores were: Univer- 

sities plus 16; Centers plus 13; Sponsors plus 20? Super- 
intendents plus 24. 
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5. On the other hand, the universities and the centers 
disagree with the related proposition that personal 
connections play too la rge a part in th e allocation 
o£ R&D resources .^ The disagreement by the centers 
is stronger than that of the universities* However, 
the sponsors again dissent from the others. They 
agree, which again shows consistency with their 
opinion that resources are channeled to an elite few’. 



6 . 



The widest discrepancy of opinion among the three 
groups was on the proposition that R&D suffers 
greatly from a lack of direction *2 With considerable 
capacity to provide direction ( tHrough the allocation 
of funds) the sponsors agreed strongly. The univer- 
sities agreed mildly, but thu centers clearly dis- 
agreed, perhaps because they see their own direction 
from their terms of reference. 



As to the proposition that the management of R&D 
reso ur ces apparently follows^ no identifiable stra - 
tegy i 3 the universities and the centers disagreed 
mi laly , while the sponsors showed rather strong 
agreement. 



3. All three groups agreed that in many cases R&D sup- 
port is the ma t t er of being in "the right place at~ 
the right "time . ^ Agreement by the sponsors and the 
universities was strong, with the sponsors agreeing 
with significantly more force than the universities. 
Agreement by the centers was weak; their attitude 
was almost neutral. 



^Appendix C, Question A6. The weighted scores were: Univer- 

sities minus 14; Centers minus 30; Sponsors plus 8. 

o 

^Appendix C, Question E6. The weighted scores were: Univer- 

sities plus 8? Centers minus 23? Sponsors plus 44. 



^Appendix C, Question A7. The weighted scores were: Univer- 

sities minus 9; Centers minus 9; Sponsors plus 26. 

^Appendix C, Question A5. The weighted scores were: Univer- 

sities plus 29; Centers plus 4; Sponsors plus 41. 
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9, Perhaps the most relevant proposition in this series 
is that the ultimate value of specific research pro- 
posals is seldom heavily^weighted in the process of 
selection and allocation of support . 1 The univer- 
sities and the centers disagreed, but not with much 
intensity, while the sponsors were neutral. One 
wonders what the response would have been if the 
proposition had been couched in positive terms and 
in a normative sense, e.g., the ultimate value of 
specific research proposals should be heavily weighted 
in the process of selection and allocation of support. 

The responses to the above 20 propositions were selected be- 
cause they illustrate four principal conclusions, namely, 

(a) that as a group, the respondents hold very strongly to 
the position that educational research and development is 
importcnt to progress in the education field, (b) that they 
believe the output is falling considorably short of making 
its potential impact on the educational community at the 
classroom level; (c) that in order vo increase the effective- 
ness of research and development activities, they would place 
more emphasis on dissemination and implementation of research 
and development results, and (d) that they would like research 
and development activities to be directed more than is now 
the case to the solution of perceived classroom problems. 

These conclusions are consistent with the findings of tne 
Impact Survey as shown in the first part of this chapter. 
Together, trie two surveys imply the direction of change which 
would be most useful to the people in charge of teaching and 
most acceptable to the research and development community. 

The strongest implication, of course, is that research and 
development efforts should be considerably more action- 
oriented. 

Another inescapable conclusion (at least so far as the data 
represents the facts) is that the sponsors, as a group, are 
much more critical than the other groups of the effectiveness 
of research and development as it is now organized and directed. 
They believe more strongly than the other groups that research 
and development efforts fail in the delivery and implementa- 
tion aspects. They are less satisfied than other groups with 
the allocation of research and development resources. And 
they are considerably less satisfied than the other groups 
with the use of research and development resources. 



^Appendix C, Question Al . The weighted scores were: Univer- 

sities minus 21? Centers minu 3 10? Sponsors plus 3. 
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It could be inferred from this that the sponsors are falling 
down on their job — since they control the funds, and there- 
fore have a great deal to say about how the funds should be 
used. However, this would be an incorrect inference. It 
should be remeiYbered that the respondents in the sponsor 
group were representatives of individual sponsoring institu- 
tions, and the questions were put to them with respect to 
research and development activity as a whole. Furthermore, 
corrective actions that any one of the institutions alone 
could take are limited either by the terms of legislation 
(or foundation charter) or by the relatively small amount of 
funds under control of the individual institution . 1 A more 
valid inference is that the Sponsors, as a group, see the 
problem from a broader perspective than do the people (again 
as a group) in the universities and the centers, and feel 
more strongly that there is a need for reform. 



In the text above there were cited only 20 of the 35 proposi- 
tions covered by the Attitude Survey. The ether 15 were 
either of marginal significance, or were not readily clas- 
sifiable for purposes of exposition. These 15 propositions, 
together with identification of the question number (Appendix 
C) and the weighted scores are as follows: 

R&D resources should be more evenly spread within the 
education a l community. (Question A3. Weighted scores : 
universities minus 49; centers minus 41? sponsors 
minus 13 . ) 

R&D funding should b e prima rily a function of a well de- 
fined hierarchy of priorities ." (Question A4 ^ Weighted 
scores: universities plus 17? centers plus 45? 

sponsors plus 32.) 

A major R&D shortcoming is a l ack of structure which 
would insure feedback of results . (Question B1 . Weighted 
scores: universities plus 32; centers plus 33; sponsors 

plus 68; superintendents plus 51.) 

Differentiation of the terms "research" and "development " 
Ts simp l y one of example of the bureaucratic red-tape 
which strangles the researcher . (Question B2 . Weighted 
scores: universities minus 49; centers minus 46? 

sponsors minus 18.) 



1 These limitations apply with much 
and development activity sponsored 



less force to the research 
by the Office of Education. 
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R&D sponsors should forcefully encourage close communi- 
ca tion among researchers doing related work, (Question 
ITJI Weighted scores: universities plus 50; centers 

plus 39; sponsors plus 34.) 

Within R&D i there appea r s to be a tendency to "ride an 
old horse to death 11 rather than to "seek a new mount”. 
(Question B5 . Weighted scores : universities minus 26? 

centers minus 10; sponsors plus 21; superintendents 
plus 4.) 

The decision-making process within R&D is in the hand s 
of a few very powerful individuals "] (Question B6 . 
Weighted scores: universities minus 12; centers plus 

8; sponsors plus 10.) 

In genera 1, R&D funding agencies (spon s ors) are respon- 
sive to the needs of the researcher . ^Question C2. 
Weighted scores: universities minus 1; centers plus 11? 

sponsors plus 3 . ) 

In order to secure R&D support/ the researcher must gen- 
erally resort to trade-otts or Tabeling of one form or 
another t (Question C3. Weighted scores: universities 

plus 21; centers plus 5; sponsors plus 20.) 

Most R&D sponsors are inflexible and, hence, once fund- 
ing has been obtained, researeners are unable to in- 
corporate desirable innovations or changes in research 
design as the project proceeds . fQuestion C4. Weighted 
scores : universities minus 25? centers 46; spon- 

sors plus 6.) 

Individual researchers reflect little more than financial 
allegiance to sponsoring agencie s" (Question C6. 

Weighted scores: universities minus 21? centers plus 4? 

sponsors plus 10.) 

Individual projects and investigators are granted so 
much autonomy that effective monitoring of the overall 
impact of li&D is impossible ^ (Question D5. Weighted ' 
scores : universities minus 31? centers minus 14; 

sponsors minus 3.) 

The majority of R&D p rojects may be classified as "flash- 
in -the -pan 7 ' operations"! (Question E3. Weighted scores : 
universities minus 29; centers minus 40; sponsors plus 2.) 




F or decision-making purposes/ ic is useful to categor ize 
R&D activities in terms of research, development, dis- 
semination, diffusion, and training" ! (Question FA . 
Weighted scores: universities plus 44; centers plus 26; 

sponsors plus 49.) 

Due to wide-spread over-lap of efforts, the R&D network 
re presents a tremendous waste of resourc es. (Question** 
E5. Weighted scores: universities minus"~^9; centers 

minus 48; sponsors plus 8.) 
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CHAPTER V 



CONCLUSIONS AND OBSERVATIONS 



The purpose of the study undertaken by SURC and reported here 
was to review the state of research and development in educa- 
tion in the United States. The limited scope of the investi- 
gation does not make it possible to use these findings to 
modify strategy or to develop new ones for the future. Much 
has been learned about how people -- sponsors, performers and 
users -- feel about educational R&D at a particular point in 
time, but very little about why they feel the way they do or 
whether they would feel the same a month or a year later. 

In consequence, this is a status report which, if it is to 
serve the ends of policy formulation, must be coupled with 
past and future surveys to reveal trends in perception and 
attitude among the three claimant groups. 

Educational research and development is alive and evolving 
in the United States, but measured against the need, it can 
hardly be defined as "well". It enjoys no great popularity 
among those it is designed to serve. This, along with con- 
tinuing low-levels of funding, adds up to a serious problem. 

There is certainly no national strategy for educational R6 D . 
The collectivity called educational R&D is, in fact, an 
abstraction representing quite diverse, decentralized and 
unrelated scholarly enthusiasms in universities, R&D Centers, 
Laboratories, and various and sundry private organizations. 
Many of the recent innovations identifiable in American 
schools seem to have come about because of political or 
scholastic fears and fads rather than as a result of conscious 
and systematic R&D efforts. 

That change takes place in American education, and that sons 
of this change may be attributable to the work of specialis ts 
in educational research and development, goes without sayiig. 
But, there is little in the field of education that permits 
the organization of talent around the accompli shment of a 
single , over-arching mission — like NASA's first moon shot. 
Educational goals are set pluralistically. They are diverse, 
sometimes contradictory and often difficult to articulate. 
Frequently, they are lacking in fixed standards or in recog- 
nized instruments of evaluation. It is, therefore, difficult 
to identify, let alone measure, the full impact of the roug- ly 
$250 million a year spent from public funds or. educational 
R&D in this country. 
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On the positive side, the shift in strategy by the Bureau of 
Research from classic scientific inquiry to programma ic 
approaches which focus on pertinence rather than long-range 
relevance, and which emphasize the transfer of knowledge as 
a necessary corollary of its development, is of relatively 
recent origin. Much of the undercurrent of rejection ex- 
pressed in the atti tude-and-impact surveys is probably re- 
lated to the old approach and may largely disappear as the 
results of new programs move out into the field. 

The attitude survey reveals that the problem of dissemination 
is troubling sponsors, performers, and users alike. The 
common viewpoint is that techniques for information transfer 
are still inadequate in spite of the success of ERIC, the 
Centers and the Laboratories. 

Additional conclusions which the study produces are summarized 
by chapters in the following, as an aid in recalling the 
detailed substance of the report. 

Introduction and Chapter I . Federal government agencies are 
the dominant forces in educational research and development. 
State agencies sponsor a limited amount of research and the 
amounts of funding vary widely among the states. 

There are substantial R&D efforts in agencies other than USOE 
but such programs are secondary and generally tailored to 
meet the requirements of primary programs. It is unfortunate 
that the results of such research are not made available to 
the schools and public on a systematic basis. 

The now cohesive strategy of sponsoring programmatic research 
and improving dissemination adopted by the Bureau of Research 
on the recommendation of its Research Advisory Council has 
been welcomed by sponsors, performers and users alike. One 
of the continuing difficulties in dissemination is the belief 
of the academic community that such work is not their respon- 
sibility. While the importance is acknowledged, the aca- 
demician sees it as the responsibility of others. ERIC, and 
to a lesser extent the Centers and Laboratories# have achieved 
some success in this endeavor. 

Research and development conducted by state departments of 
education vary both in basic interpretation of the purposes 
and processes of research and in the method of support. 

Further detailed study of ways to improve research sponsored 
at the state level is warranted, but a preliminary conclusion 
is that opportunities for cooperative research at the labora- 
tory level are being neglected. There is a need for greater 
cooperation, especially on Title I and Title III projects. 
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Chapter II. Private foundations play a secondary role as a 
source of educational research and development funding, 
sponsoring an estimated $15 to $20 million compared to over 
$15^ million dollars by the Federal government. They are 
important, however, because they tend to support programs 
of relatively high risk, are less inhibited about subject 
matter than the government, and are more willing to sponsor 
outright experimentation. 

In general, private foundations do not budget for educational 
research and development as a specific interest. They give 
their support in broader classifications such as race relations, 
urban studies or aid to education. 

Chapter III. Universities, because of faculty independence, 
do not engage in programmatic educational research and 
development to a significant degree. 

Research and Development Centers and Regional Laboratories 
tend to work in the middle ground between pure project 
orientation and a fully programmatic approach. While USOE 
favors the latter, the Centers and Laboratories are not, 
as originally planned, suf ficiently multidisciplinary in 
personnel or interdisciplinary in philosophy to conform * ;> 
legislative intent — at least as interpreted by top staff 
in the Executive Office of the President. There is heavy 
emphasis on backgrounds in education and psychology among 
the members of such agencies. The laboratories seem somewhat 
more rounded in talent than the centers. 

Chapter IV. On most matters brought up in the impact and 
attitude survey, sponsors, performers or users seemed to 
have great difficulty in forming and holding opinions. 

They not only disagreed on a group-to-group basis , but 
given essentially the same question in varying forms each 
group shifted its position in response to various phrasingo 
of the question. 

In general, the conclusions are that: 

1. On the whole, the respondents support the position 
that educational research and development is impor- 
tant to progress in education; 

2. They believe that the output is falling short of 
fully realizing its potential impact on the educa- 
tional community at the classroom level; 

3. They would place more emphasis on dissemination and 
implementation of research and development results, and 

4. They favor activities which are directed more than is 
now the case, to the solution of perceived classroom 
problems . 



APPENDIX A 



THE SURC INTERVIEW SCHEDULE FOR R&D CENTERS, 
REGIONAL LABS, UNIVERSITIES, 

AND STATE DEPARTMENTS OF EDUCATION 



Instructions to Interviewers App A-l 

The Interview Schedule App A-4 



LISTS OF INSTITUTIONS WHERE INTERVIEWS WERE 
CONDUCTED, AND NAMES OF RESPONDENTS 



Non-Federal Institutions App A-ll 

Federal Institutions App A-l 5 




102 



GENERAL INSTRUCTIONS TO INTERVIEWERS 



A. Syracuse University Research Corporation, through its 
newly formed Policy Institute, is conducting a survey of 
Educational Research and Development in the United States. 

The end product of the survey will be a report to the U.S. 
Office of Education for consideration by that Office in the 
preparation of a briefing document for the Organization for 
Economic Cooperation and Development in Paris. 

The focus of the survey is on the management of both finan- 
cial and professional resources devoted to Educational Re- 
search and Development in universities, centers, and other 
American institutions . 

We are interested in exploring two basic questions: 

a. What is the nature of the decision-making process 
within the R&D complex with reispect to the allo- 
cation of total resources (funds, manpower, facil- 
ities , etc . ) , and 

b. What has been the actual, or what is the potential, 
impact of R&D endeavors on educational policies and 
practices at the "consumer" (e.g., classroom) level? 

B, The total survey will cover several levels of institu- 
tions (and the people associated with them) which play a 
role in determining the content and direction of educational 
research and development — and the interaction among them. 
These levels break down, roughly, into three: 

1. The sponsors : these are principally the Federal 

government, and the Foundations. 

2. The performers : these are the institutions (and 

the people in them) which actively engage in 
research and development work, 

3. The con s umers : these are the institutions which 

actually - engage in instruction or educational 
programs. They are, o:! course, overwhelmingly 
school systems and institutions of higher educa- 
tion, Their relevance to research and development 
activities is two-fold: (a) in their receptivity 

to research and development resultr, and (b) in 
their capacity to influence research and develop- 
ment activities by sponsors and performers through 
articulating tne need for new knowledge about 
educational techniques . 
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You will be dealing with, and reporting about, the middle 
group — the performers. The sponsors and consumers, along 
with some other groups in the network, are the subjects of 
separatr studies, 

C. The institutions to be covered by the "performer" seg- 
ment of the survey — - the segment that you are concerned 
with -- vary considerably in management structure, purpose, 
and outlook. They include the research components of uni- 
versity schools of education, other departments in universi- 
ties, R&D centers, regional educational laboratories, state 
departments of education, and some miscellaneous institutions. 
Accordingly, your first problem is to fill out Interview 
Schedule I . Among other things, in this schedule you will 
describe and categorize the institution whose personnel you 
are interviewing. You can, and should, get much of this in- 
formation prior to the actual interview, so that you will not 
enter the interview cold. 

D. Interview Schedule II is the heart of the exercise. It 
contains questions which, so far as possible, were designed 
to fit the modality of the structures, etc., of the subject 
institutions. However, in contrast to the rigidity of the 
questions in many interview schedules, these need not be 
adhered to exactly. Because of the variations in institu- 
tional structure, there may be cases in which the exact 
phrasing of a question is not suitable, or where a question 
should be eliminated entirely. Also, the course of the in- 
terview may be such that the order of the questions should 

be changed. Use your own judgment on these points. However, 
it is important that all of the questions in this schedule 
(as well as in Schedule I) be accounted for in your report, 
even if the accounting is simply a statement such as "Ques- 
tion eliminated because.. ♦ 

It is essential that you be thoroughly familiar with this 
questionnaire prior to the interview. i?a^ particular atten- 
tion to the notes following each question; they are designed 
to be guides for you. 

Additional interviewing instructions are attached to the 
schedule . 
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Special Instructions for Schedule II* 



E, We are not providing space for you to record answers on 
the interview schedule itself, mainly because so much blank 
space would add bulk to the formidable looking mass of papers 
in your hands, and this might initially alienate many res- 
pondents* Make your notes on a separate pad* If possible, 
and if the respondent agrees, use a cassette type tape re- 
corder, and send the cassettes to us after you have finished 
with them* We will pay you for the cassettes, of course. 

r. Many respondents will give you material of one sort or 
another as part of the reply to some of the questions. When 
you are finished with this material, please send it on to us. 

G. Please note the following: 

1, Some institutions have many functions besides 
educational research and development. Notable 
examples are university schools of education and 
state education departments. In such cases we 
are interested only in the educational research 
and development function . 

2, We are interested only in research and development 
which has, or can be expected to have, a bearing 

on educational policies and practices. Specifically, 
we are not interested in "operational" or "record 
keeping 7P ^fesearch concerning such matters as the 
adequacy of the tax base for school financing, fore- 
casts of student populations, rates of teacher turn- 
over, etc. This caveai: is particularly relevant 
to state education departments and to some indepen- 
dent institutions such as the Educational Testing 
Service. (However, we are interested in knowing if 
an institution consideriTTVtis "operational" research 
to be an important priority.) 

3, Some respondents might say that they have already 
sent us a mass of material which contains answers 
to some of the questions you will ask. In many 
cases this will be true. Please explain that this 
material was requested in connection with another 
segment of this project, that it is in use, and 
that it could not (physically) be made available 
to you. Apologize on our behalf for the apparent 
duplicating or overlapping, and try to leave feelings 
unruffled . 



For R&D Centers, Regional Laboratories, Universities, and 
State Departments of Education. 
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Please emphasize to your respondents that this is not 
an official U.S. Government survey. It is a survey 
being made for the U.S. Office of Education, and not 
by the U.S. Office of Education. The distinction 
may seem not to be significant but for various and 
complicated reasons it is a very important distinc- 
tion to the U.S. Office of Education. 



INTERVIEW SCHEDULE II 
Questions 



QUESTION 1, 

PLEASE DESCRIBE ONE OF YOUR REASONABLY TYPICAL EDUCATIONAL 
RESEARCH OR DEVELOPMENT PROJECTS. 

Notes to Interviewers; 

1. Record briefly the description of the project. 
Seek answers to the following questions: 

a. How was the project initiated? 

b. Whose idea was it? 

c. How was the project funded (how did you get 
the money, and from whom)? 

d. Were you invited to take it on by a sponsor, 
or did you have to "sell" it? 

e. How were members of the project staff 
selected? 

f. What major obstacles did you encounter? 

g. To what extt t i.ave results stimulated 
further research and development activity? 

h. What have been the feedback results? 

2. We have asked for a description of a "reasonably" 
typical project. In what respects is this one 
not typical? 
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QUESTION 2. 



ASSUMING A PROJECT WHICH HAS BEEN "PROVEN OUT" IN BOTH THE 
RESEARCH STAGE AND THE DEVELOPMENT STAGE, WHAT DO YOU SEE 
AS THE SUBSEQUENT STEPS TOWARDS IMPLEMENTATION IN THE SCHOOLS? 

Notes to the Interviewers; 

1. Try here to determine the institutions 1 s concern 
with carrying its research results through to the 
ultimate consumer. 

2. Would the Institution actively push implementation? 



QUESTION 3. 

WHAT ARE THE MAJOR AREAS OF RESEARCH CONCENTRATION WITHIN 
YOUR R&D PROGRAM? 

Notes to the Interviewer s: 

1. Delineate the areas in general terms. 

2. Determine approximat e ^osource allocation (funds 
and people] to~~each area. Accept such terms as 
"major" down to "peripheral" or "marginal." 



QUESTION 4. 

WHAT FORMAL CONSTRAINTS (IF AN Y) ARE THERE TO ADDING NEW 
AREAS, OR TO SHIFTING EMPHASES? 

Note to Interviewers : 

This question is especially important for institutions 
which depend on sustaining funds tied to prescribed 
termj of reference. Institutions very often manage 
to wriggle out of the prescribed constraints. We want 
to know what freedom of action the institution actually 
has, in spite of the existence of formal constraints . 
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QUESTION 5. 

WHERE DO YOU GET THE GUIDELINES FOR DETERMINING THE AREAS OF 
EMPHASIS WITHIN THE PROGRAM? 

Notes to Interviewers: 



1. Caution: be careful on this question. The res- 

pondent might be setting the guidelines himself/ 
and might resent the question „ But 

2. Seek out, in terms of title or position/ specific 
individuals, internal committees/ advisory groups, 
consultants, etc. 

3. In some cases the true answer will be that the 
areas of emphasis will be determined by contracts, 
grants, etc., which just happen to fall to the 
respondent 1 s institution . 

4. Also, try to determine the relative importance 
of internally generated and externally l, invited" 
projects . 



QUESTION 6. 

WHAT KINDS OF INTERNAL AND EXTERNAL CONSIDERATIONS, OTHER 
THAN THE FORMAL ONES, AFFECT YOUR INSTITUTION 1 S KEY DE- 
CISIONS ABOUT MAJOR AREAS OF EMPHASIS AND ABOUT TAKING ON 
NEW R&D ACTIVITIES? 

Notes to Interviewers ; 

Examples of such considerations: 

Internal: Scaff interests, space, personnel. 

External: Peer groups or sponsors, financial 

support. 



QUESTION 7. 

WITHIN YOUR MAJOR AREAS OF INTEREST, WHAT GROUPS WITHIN THE 
EDUCATIONAL COMMUNITY WOULD YOU IDENTIFY AS TARGET AUDIENCE 
OR CONSUMERS OF YOUR R&D ACTIVITY? 
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Notes to Interviewers: 



1. Identify any number of classification of target 
audience or consumers with each area of interest. 



2. If more than one category of target audience or 
consumer is identified for a particular area of 
activity, attempt a rank order. 



Example : 

Area of interest: Language instruction 



Consumers : 



a. Non-English speaking minority 
groups 

b. Secondary school level 

c. Adult education 

d. Elementary school level 



Area of interest: Individualized instruction 



Consumers : 



All levels 



QUESTION 8. 

WHAT ARE THE MAJOR SOURCES OF YOUR FINANCIAL SUPPORT? 
Notes to Interviewers : 

1. Try to get approximate distribution over the 
past five years or so, with sources identified 
according to the following categories: 

a. Own funds or appropriations. 

b. Federal government (agency or agencies, if 
pertinent) . 

c. Foundations. 

d. Industry. 

e. Other. 

2. Try to establish a trend. 



QUESTION 9. 

DO YOU HAVE STANDARD PROCEDURES FOR OBTAINING FINANCIAL 
SUPPORT FROM EACH OF SEVERAL SOURCES WHICH FUND YOUR 
OPERATION? IF SO, PLEASE DESCRIBE THEM. 
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